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Technical Assistance Dcvtelopment System 
Evaluation Report for I98O-8I 
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INTRODUCTION 



This report submitted by the Technical Assistance Development System 
(TADS) pursuant to its contract /'300-80.-0752 with the Special Education 
Programs (SEP). It contains a sunmary of the evaluation findings related 
to TADS' delivery of technical assistance services to fifty-three Handicapped 
Children's Early Educat i on Prog ram (HCEEP) demonst rat i orr projects and thirteen 
Stat6 Implementation Grants (SIGs) in the eastern United States which were 
funded by SEP for I98O-8I. Supplementary information also is prov i ded wh i ch 
describes services to other clients, such ^s newly funded projects and SIGs 
or outreach projects. , • 

The primary purppse for developing the report is to provide information, 
concerning the accomplishments of TAD!5 to the funding agency-SEP. The report 
will also be useful to TADS by providing information which can be used to 
J^prove future services to Its clients. 

Evaluation activities for the I98O-8I contract year Included two add i- . 
tlonal special endeavors. An evaluation study comparing three types of needs 
assessments for demonstration projects was completed, Thelplnal report of 
this study has been submitted separately. \ Also, the first year of a three- 
year case study of TA provided to demonstration projects was conducted during 
1979-80, A report was prepared for the first year, and data collection for 



the second year was completed. The results of this second year of the study 

,» 

will be described in a separate report. ^ ' 

•f 

This evaluation report is divided Into five sections/ The first one 

provides a description of TAD^^nd the evaluation plan. It provides back- 

•t 

ground Information to assist the reader in interpreting the results which , 
follow. The second and third sect i ons present evaluation find/ngs related 
to services delivered to the I98O-8I HCEEP demonstrat ion projects and SIGs, 
respectively. A fourth section provides information on services that TADS 
provided to other clients. The final section presents a summaVy an^ discussion 
of the overall results of the evaluation. 




< SECTION I : BACKGROUND 

V ^ 

TADS^ Workscope for I98O-8I 

The proposal to SEP which outjined TADS' work for this contract period 
specified five broad goals: 

(1) To assist eastern HCEEP demonstration projects in developing a 
proqram of exemplary services for young handicapped chi Idren 

and their families that can be demonstrated and institutionalized 
effectively in their community and state. ^ 

(2) To assist eastern state education agencies in stimulating and 
implementing programs for comprehensive services to young handi- 
capped children and their families^. 

* (3) To communicate and disseminate information about early childhood, 
special education, and • techn I ca 1 assistance issues, concerns,, and 
programs as they relate to demonstration projects, states with 
implementation grants^ and other designated targets. 

(k) To provide systematic program evaluation services to HCEEP 

demonstration projects, states with implementation grants and 
TADS. 

(5) To provide an admi nisSt rat i ve and management system that effectively 
and efficiently guid4s and monitors contract performance. 

These broad goals were further delineated intp activities under a series of 

long- and, short-term objectives and, accompany i n'g activities. These objectives 

and activities form the base from which the evaluation plan and data collection 

procedures were developed. 

'» 

The Evaluation Plan 

The TAof' evaluation plan (Figure I) provided for twd major documentation 
and data collection efforts. The first of ^ose, provi ded through quarterly 
progress letters, •nswered the question, ''Has TADS fulfilled the provisions 
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of its contract with the Special Education Programs?" A summary of the 
accomplishment of contract objectives which was submitted in the fourth 
quarterly progress' letter is provided in Figure 2. The second evaluation 
effort consisted of the administration of a variety of evaluation forms to 
answer the'thrde remaining evaluation questions regarding the quantity and 
quality of the technical assistance provided by TADS. The results of these 
data collection activities are presented in the next three sections of the* 
report. 



Accompl ishment of ^ Workscope Short-Term Objectives for I98O-8I 



Figure 2 
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. Services Del i ve red 

i ' * ■ ■ ' *• 

Fifty-three ^53) demonstration projects were funded in the TADS' service 

^artfa by 'SEP from July l» 1980, through June 30, I98I. Of these, twelve were 

in their first, twenty-one were In their second, and twenty were in their 

third year of demonstration funding. 

As Indicated in its contract and quarter ly >frr6ghess letters, TADS offered 
a variety of services to the projects. These included: (a) a comprehensive, 
programmatic needs assessment; (b) individualized services outlined in a 
memorandum of agreement between TADS and each project; (c) additM^nal, infor- 
mal services in response to project requests; (d) a topical workshop on issues 
in the health care/education relationship in working with infants; and (e) 
print products consisting of thre^ newsletters and seven publications. 

Forty-four of the fifty-three projects chbse to participate in the TADS* 
needs assessments. Of these, three projects, as the result of the needs 
assessment, determined that they did not need external technical assistance. 
As the year developed, four of the projects that had not participated in a 
needs assessment requested asslst^nte related to needs identified later in 
the year. Needs were Identified and memoranda of agreement were, therefore, 
developed for fortyflve projects. These received all services listed In the 
previous paragraph, with the exception of the topical Workshop, in which 



-6( 



^0 



10 " 

fifteen projects participated, three as. part of their Memorandum of Agreement 
services and twelve as a supplement to thpse services. All pi*bjects received 
copies of newsletters and publications. 

In order to describe services delivered to projects, several types of 
information were gathered and are reported here. The first consists of the 
frequency with which the various types of services were provided to projects. 
Additional Information was collected to determine and report the number of 
project related personnel v^o participated in the technical assistance and 
the number of days of technical assistance provided. Finally, <iata were 
gathered to allow an Identification of the person or persons who provided 
the technical assistance.. In this and following portions of this part of 
the report, the description services delivered will include information 
related to each of these areas. , 

Total Se rvice s 

' During 1980-81, TADS provided a total of 910 technical assistance serv- 
ices t6 demonstration projects-^ah average of 17.17 services per project 
(Table I). -Of these, were needs assessments, 119 were servi ces out 1 1 ned 
In the Memoranda of Agreement, 58 were' other services and 689 were print 
products. 

A total of 786 instances of demonstration project staff Involvement In 
TA were recorde|d, or an average of 3-56 staff members Involved per each TA 
event Involving a direct Interaction between the, projects and a TADS staff 
member or representative (Table 2). The highest level of. staff Involvement 
was recorded for the needs assessments and on-site consultations In the 
content areas of Staff Development and Services for Children. 
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58 


1.29 


Off*Slte 
Consultation 


<t 


1 


6 \. 


2 


! 




Iti 


o;3i 


Review and 
Critique 


2 


2 


- 3 


,1 


m 


1. 




0.20 


Information 
Service 


3 


3 


2 5 




'3 ■ 


• 


18 


o.i»o 


Visitation 


3 


If 


2 


m 


1 




. 7 


0* 16 


Small Group TA 




• 


5 




e 
9 




1 n 


y« ^t<6 


Other 


3 


• 




m 






3 


0.07 


Cotal 0 , 


25 


8 




IB 


t 
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1. Other Services (N » 53) 


















Additional TA 


6 


6 


7' 


16 


5 


6 


(|6 


0.87 

• 


' Topical Workshop 


12 








- 




12 


0.23 


TotcZ 


18 , 




7 


« A* 




6 


C 0 


i. 


t». Print Products (N • 53) 


















News let 




m 


m • 




• 


3»8 


3IB 


6.00 


fubff cations^ 


265 


m 


53 






53 


371 


7.00 




m 


m 


' - ' , S3 , 






3?1 


669 


13.00 


ALL SERVICES (N • 53) 


m 




12 96 


3* 


2* 


«2 * 


910 


17.17 



• - Th* tabt* dots not Inclutlo tuo ori.tntation worKsnop ror i« ywr p™j«cs», <;^.w< 

1979-80 cvaluttion rapttft. nor th« August, 1981 orl.ntitlon •«^''«J»P IS'JtfJ 212^!%^ f« thi 

b - Mln« projfcts did Borpiftletpitt In nwdi iMoiwimt. Four of ^tht»« td«Min*d^fltid» l*^iJj*^l^*,,.. 
vMr Snd fMilvtd t«ehnleil Mitstaniit. Thr«» pfojtcti rtcotwid nicds •sscstmints but did not rwu«lt 
' d"«'1«Sl«t^J!SM5u. T^^^^ tbow. d.icMb.^dlrtct tfehnlMl ...l.tinct strvle.t 

d«iierib«d In tKo Hmnndmof Aflr.tmtnt ind^rovldtd to 

e - Rtprtstntk two copUt of thr«t cdltlont of >t»%n«wtl«tttr EHf^SlS wnt to ff'SJ""; 

d - Rtpr.«tnt« .11 otNf publtettlons d«v.1op«d bfiTAOS and dUtrlbutad durl.19 this contract padod. 
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TOTAL hip AVEIWGE NUMBER OF MOJECT, STAFF FARTICIFATING 
OtHECTtV IN TECHNICAl ASSISTANCE ACTIVJTIES 

1980-81 



TA CONTENT AREAS 



Tvpp of TA . 



Chi Id 
Strvictt 



Parent 
Stfvlcet 



Staff 
Oevt. 



Ocmo/ 
Otssem. 



Evalu* 
at ton 



Ai^lmlirv. 
G Mgt. 



All 
Areas 



TOTAt* 




On-Stte ' 
Consultation 




69 

e.9c 


3 


87 


51 

3^00 


63 

4.81 


<)ff- liter 
Consultation 






2 

- • 




9 . 




Review, and 
Critique * 




. 2 
J.ff<? 


2 




5 

i.e? 


1 


Information 
Sarviee 




8 


8 

2, iff 7 


7 


9 


3 


Visitation 




k 

1.33 


3 

3.C0 






«• 


Small Group TA 








<■ 

m 


6 

2.20 


& 


Other 




9 

J. i?^ 




• 






otal 




4.: 8 




pa 
5.J7 


BQ 
2. 22 





Other Services 
Additional TA 



Topical 
Ubrkshop 



Total 



6 

1.00 

18 

24 



7 

1A7 



2.17 



7 

l.CO 



7 

2.00 



17 
2.06 



27 

1.0$ 



31 

•2 
t.20 



5 



i a w W 

6 

J. 2: 



48 

2.37 



5 



5 

1.00 



301 



3 



3 

3. CO 



301 



304^^ 
27 
13 

40 * 



12 
12 

9 



<J7 




m 
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ALL SERVICES 



126 
' 2.93 



j25 



98 



87 

S.OS 



♦ 88 



50 

i.OB 




AVEMCi wiHIER OF >WJECT KLATEO FEMONNEL fER>WJECT RECEIWINO DIBECt.TA (H ■ S3) 



# - Nfirutnts feh> total wuwfcr of pfojicf tMff from til projfeli,wl» ptrtlelpaMd n th« letlvlty JUttd. 

e - Rtpraitnt* tl« avSVw numbtr of pirtlelpanti ptr project for £11. wrvlcat. Individual* wara countad 
aach tlM thay partlcipitwt lit • TA i«rvlca» ' . 
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\/^A totjal of '554.31 days, or an average of 6.70 days of dtcect TA per 
Ijrojett, were provided (Table 3) • The greatest length of^^tfrne spent In 
TA, on the average, was in iHfi content areas of Services for Children and 

' Oemonstration/Di'ssemination and in the TA>.services of off^site consultations 

and reviews and critiques. On the average, each TA event tasted approximately 
a day and one*ha1f. ' 

Overall, the majority of TA services were provided by the TADS' staff . 
or its' consultants (Table 4). TAOS' staff conducted most ol the needs assess* 
ments and Information services and provided all of the additional TA. TADS' 
consultants conducted most of tl^^arv^and off'-.sTte consultations, rev-lews and 
critiques and visitations. A variety of persons from SEP, WESTAR, HCEEP 
projects and other consultants contributed to the small group TA meetings 
and the topical worlcshop. 

' ' ' ' • . 

Specific Services 

' Heeds Assessment. Needs assessment, as defined and conducted by TADS, 
Includes a comprehensive rlivlew of a project's program, an Identification of 
areas In which the project wttl nee(| to focus Its efforts during the year, 
and an Identification of thosiB areas In which the project would benefit from 
technical assistance from TADS.' This year TADS provided two* tyj^s of assess- 
ments: on-site and self^assestment* , On-stte assessments were conducted with 
all first year project^s and those second and third year projects that requested 
)r, on the basts of TAOS^ and the project's optnforii needed an on^^slte isstss* 
ment. The remaintng second and thf rd year projects conducted stif-'asiessinents. 

Three*hundred and project related personnel. ptrttetpated tn the needs 
a«essment» an avtraga of $.^k at sach project site. On the average, fourteen 
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torn AtflMCE NUMBER OF OAVS OF OIRICT 
TECHNICAL ASStSTANCiE PKOVtD&Q. fo PKOJECTS* 



' ^Typt 0/ TA % 






. 'J • 

' CONTENT AREAS 






• TOTAL^ 


Child 
Services 


f^arent 
^ervlces 


Staff 
Oevt. 


Pemo/ 
DIssem. . 


Eval,u* 
atlon 


Adffli n . 
6 Hgt. 


Alt 
Areas 


Netdt Mi^^tn^tnt 














74 .'88 


7^.88 
















2.70 


2.7C 


i Mtnorandum of 












• 






















j 


Oo-Sitc 


23. ij 


J. 00 


16.63 




31.00 


15.00., 


' m 


1 134.01 


«Cdf)9uJcat ton 




2. t?f 


r. a 






i.e? 








1 1 « JO 


9 cn 






t fit 


A CA 




411 At 
39.01 


Consultation 


2. Si 












> m 




Review and 


*.50 


4.00 




5.75 


. 3-00 




11.00 


28.25 


Cf t tJQue 












«» 


22. :o 


3.14 


tf^formac^on 


1.50 ^ 


1.09 


1.00 


4.00 


1.25 


2.88 


m 


11.63' 


Servi^ce 






a: 




r. es 


c. ss 

• 


m 




VlfUatlon ^ 


8.88 




3.50 






• 

( 




15.38 


Small Group TA 








6.50 




7.50 




14.00 






m 








2.10 






Other 


5.25 








m 




m 


5.25 






m 


«» 


m 












£4.ie4 


20. SC 


22.2s 


9i. BO 


36. 68 


2?.tB 


22. CO 


217. £J 






2.32 


2.?e 


2.38 


2.0$ 


1.4? 


2r. sc 


2.: 3 


Other Servleet 
















4 


Additional TA . 




2.75 




2.13 


3.13 


. 0.63 


1.25 


n.so 




O.SP 


0.46 


m 


0.30 


0. ZO 


0.13 


0.21 




Topical 


21.00 ' 


m 


m 






m 


m 


21.00 


Workshop 




m 






m 


m 




i.n 


Total 






m 


2. 14 


2.11 


0.63- 


l.S$ 


3l»t0 






0.46 


m 






0.13 


0.21 


0.6t 


ALL SERVICES 




13*25 
O.0d 


2t J3 
t.76 


87.63 
2.04 


40:^00 

i.ie 


28. Si 


17.13 


3S<i.9i 
l.OI 



AVEKACE NUHIER Of OAVS 6F DIRECT TA PlU PROJECT (N - 53) 
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• - Thlt dost not Includt tliiHUpm fcy tAllS ftafF fo ftcllttatlng TA. it doct. howtw«c, Includt 

preparation tlmt for tht.TA p/owld^r, TAOS itaff and/or eoniultantf. 
b - R«pras«nt« tha total numbar of dayt In which projacf ttafff partlelpatad In TA, 
c • Rapraiantt tha w.raat nunbar of dayt In which projact ataff* partlelpatad In TA. 
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Table k 



TYPE Of TA PROVIDER 
DEMONSTRATION PROJECTS 

, 1980-81 



Type of TA 



TADS 
Staff 



PROV lOER 



TAOS' 
Consultant 



Other 



Needs Assessment 



Hemorandun of 
Agreenent Services 

On-site 
Consultation 



Off^Site 
Consultation 

Review and 
Cr I t,ique 

Informat ion 
Services 

Visitation 

Smal I GrouR TA 

Total ! 

Other Services 

Additional TA 

Topical Workshop 



3^^ 



% b 1.^- 

7? ' 



14 



I 11 



16 89 



23 - 24 



U6 ICO 



46 98 



H 

10 



" ^9 84 



10 71 



8 S9 



11 



100 



76 



66 



14 



10 i:c 

12 IC 



ICC 
2 



m 



ALL SERVICES 



108 



S2 



86 



42 



13 



a - Includes servifces provided' by TADS and UESTAR^ SEP, artd/or consultants, 
b - Percentage of all services provided. 

c - This particular percentage includes TADS,' r;espbns<ibMlt1es for 26 self assessments, I .e.V preparing 
materials and ans%Mring questions ppsed by projects. ; When splf assessments are not counted, TADS* 
staff conducted 8 needs assessments representing iS^of the services provided. 
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hours were spent by the project and TADS In completing eac*h needs assessment. 

On-site heeds assessments wefe^c^^ either by TADS' staff or 

trained consultant/needs assessors. Self ^assessments were conducted bV the 

r 

projects using a comprehensive manual prepared by TADS. 

, A total of one-hundred twenty (120) needs, or two-torthree| per project, 
were identified and included In Memoranda of Agreement for TA. The greatest 
number of needs were in the content area DemonstratTon/Dissemination (36%) 
(Table 5). Fewest needs were identified in the area of Services to Parents 

(7?). ' ■■ ,■ " ' , , .. •• ' 

When viewed from the perspective of the type of assistance the projects 

needed, most of the needs were for some type of information (Table 5). 

• ' ' ■ . : ■ ' . i 

These typically were needs fof specific examples of products or an overview 
of the latest developments in an drea, e..g., assessment of parent needs. 
Needs were also often expressed for assistance in planning and revising or 
refining aspects of project Qperation or specif ic plans or products. 

. ,i^ring the year,, needs were changed as a result of changes in the proj- 
ects. Seven needs were added when project staff contacted TADS to request 
<l?rect assistance in an area. Eighteen needs were cancelled during the year; 
Of these, seyehty-eight percent or l^* were cancelled at the reqiiest of the 
projects thetnselve^. Twenty-two percent or k were cancelled by TADS or by 
TADS and this project staff. The results related to technical assistance in 
this report are therefore based on services designed to meet one-hundred and 
nine (109) project needs. 

Memorandum of Agreement Services . As needs assessors and project personnel 
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Table 5 






1 


FREQUENCY ANO PERCENTAGE Of NEEOS lOENTinEO 
CONTENT AI^EA ANO^ TtCHNICAL ASSISTANCE NEEOEO 
OEHONSTRAT ION PROJECTS 
1980-81 


BY 


• - ■ 


■• ' - — ■ . . ,. 








'■ 






Project Year of Funding 


^ ■ ■■ [ 


Type of Need 




. 1st yr. 2nd yr. 
(NiiltO) (M-53) 


3rd yr. 
(M-27) 


Total 
(M-I20)a 


CONTENT AREA 










Services for ChMdren 


f 

? - 


9 8 


1 

4 


18 . , 
IS 


Services for Parents 


t 
I 


S 3 

:2 


0 


a 

7 


Staff Development 


f 
I 




.■6 . 

r2 • ' 


16 


Oerionst rat Ion/0 i s semi nat Ion 


f 

? 


7 19 


17 


Ji3 


Evaluation 


f - 
% 


1 s ' 

IB / 17 ' - 


3 


,19 


Adm i n i s t r a t i on /Man agemen t 


f 


8 , 8 

20 . IE 


0 


16 


TECHNICAL ASSISTANCE NEEDEO 










OecT si on -making 


f 


1 I 

2 ? 


1 


■ 3 
,3 


Planning 


f 


10 10 

25 ■ 19 


5 


25 

22 


Information 


f 

. T 


18 " 28 ' 
4S 63 


7 

27 


53 . 
_ ' 44 


Ski 1 l$/competencies 


f 


k 3 

:o & . 


5 *^ 


12 , 

■ JO 


Product Oeveld^ment 


f 


2 « 

6 2 


...J/.,' 


6 


fte V 1 s I on s/ re f i nemen t 


f 
I 


2,9 

■6 .17 ■ 


6 

,22 ... . 


17 

J4 ■ , ■ ■ ■ 


'Program Otvelopm«nt 


f 


3 ' « 

S . . 2 


0 

0 


■3 


. a • N • number of needs ipacSfted In original Hemoranda of Agreement. * 




'* ' . ' ' . 

' ''4 


) . ' 






■ ^. 

f 





identified needs for technical assistance they also determined the type of 
technical assistance services^ ttiat would best meet the identified needT The 
needs and services Identified weKe reviewed by> %he TADS' staff for their 
appropridtene«ss and feasibility. The needs and services were described ih 
detail in a Memorandum of Agreement Which specified the activities to be 
accomplished by TAOS and the project to meet the project's individual needs. 
Reflecting the need^ identified* most of the 119 services delivered from the 
indi vidJal ized Memorandum of Agreement were in the content areas of Demonstra** • 
tion/Dissemination (36)t Services for GhildVen (25) i Administration/Management 
(19), and Evaluation (18). The most commonly used type of service delivery 
(^?%) was the on-site consultation in which the project director and/or staff 
worked directly with one or more consultants. 

Over four hundred (417) persons from projects participated in the services 
specified in the agreements**-an average of almost four participating in each 
.event. By far the greatest number of staff (30A) participated in on-site 
consultations. Most, oh the average, participated in TA provided in the ^ S» 
content areas of Staff Development (8. 17) , Services for Children (4.08), and 
^Valuation (3.94)- Fewest people per project, on the average, participated in 
small group TA (nee tings (1.20) and reviews and critiques (1.44) and the 
content areas of Services for Parents (2.25) and Demonstration/Dissemination 

(ir.22)/ 

The lengthiest TA services, on the average, were the off-site (2*79 days) 
and on-site (2.31 !d9ys) consultations and in the content areas of Demonstration 
Dfssemination (2*38 days) and. Services for Children (2.19 days). (The average 
for reviews and critiques w^s inflated by one which requ I red 11 days. Without 
this event the average .for reviews and critiques was 2.15 days.) Those of 
shortest duration, on the average* were Information services (.^5 days) and 



those services which covered Administration/Management (I.A? <*ays) and 
Services for Parents (1.31). * ^ 

Mos^ services specified In memoranda of agreement were provided by 
TADS' consultants (66%). The remainder were provided by the TADSV staff 
(2*%), and the TADS' Staff and Others (10%). 

Other Services . In addition to the services provided In the Memoranlda , 
of Agreement, TADS' staff provided Individualized assistance to projects, 
within given time and resourcfe constraints, uppn request. These were called 
additional TA and were provided most often in the content area of Evaluation. 

No additional TA was provided in the area of Staff Development. 

«* • * ■ 

Fifty project persons were involved in the additional TA. Most, on the 
average, were involved in the content area of Evaluation. 

On the ave r age, r eq u e s t s for additional TA were pr e pared in 2 hours ' — 

, (.25 days). All additional services were provided by the TADS' staff. 

Infant Health Care/Education Workshop . A workshop fbr demonstration 
projects, SIGs, and outreach projects working with In^ts with special needs 
and their families was held In March 1981 in New Orleans. It was conducted by 
TADS and WESTAR, with the assistance^ of additional resource consultants. A 
total of fifteen projects from TADS' service area were represented. In addi- 
tion, eastern outreach projects, and western projects, SIGs, and, outreach 
projects attended representing HCEEP; and additional Interested professionals' 
were Invited, for a total participation of approxlhiatelv 120 persons. 

Print Products. AH projects were sent two copies of three Issues of 
the TADS' newsletter Emphasis and seven publications developed by TADS or 
with others: (a) the 1980-81 HCEEP Overview and Directory ; (b) the 1980 
Minority Leadenshlp Workshop Proceedings: Program Strategies for Cultural 
Diversity; (c) Finding and Evaluatlno the Hlgh-Rlsk and Handicapped Infaat j 



(d )• Pianning Services for Young Hand! cappedv American Indian and Alaska 
Native Chi Idren ; (e) The Young Black Exceptional Child ; (f) the Rural 
Conference Proceedings: Serving Young Handicapped Children In Rural 
America;* an? (q) A Practical Guide to Institutionalizing Educational 
Jnndvatfons. ' 



Project Reactions to Services 

Reactions of project personnel to all TA services with the exception of 

■i ' - . ' " ' 

••additional TA'* were gathered. 

Needs Assessment 

'Project staff were asked to rate two mai^ aspects of the needs assess-* 

ment ;^ '(a) the extent to whic h the^ crite r ia fo r a needs asses^sment had been ^ 

»■ 

met; and (b) aspects of their satisfaction with the needs assessment. Over* 
all average ratings indicated that all criteria were met with the development 
of , a list of TA needs and ^ccornpanying activities being most often completed 
(Table 6). Satisfaction with the heeds assessment was ••good'* (4.68 on a 6 
point scale) with regard to meeting project staffs' expectations and approached 
••excellent^* for the remaining Items. For all Items, on-site needs assessments 
were more highly rated than self-asses'sments. 
Memoranda of Agreement Services 

Clients reacted favorably to the services provided In relation to their 
Memoranda of Agreement. For all TA content areas the ratings of overall 
quality of the service and ratings of client satisfaction with the service 
were "good" or better (Table 7). Highest ratings of quality (above "excellent") 



21 ' 

I 

' Table 6 





OF 1980-81 NEEDS ASSESSMEIJTS 


- -■. 







• 

• • 


' On-site 
Assessments 


' Self 
Assessment 


Overal 1 
Mean 




1 

Item 


(N-16^) 


(N-26) 






1. The Needs Assessment Process 










1. ProvldefJ comprehens Ive review 


5.00 








2. All needs identified 


'5.06 




'•.95 




3. List of TA needs developed 


' 5.19 


k.32 


5.02 




TA activities identifi^ed 


5.12 


k.32 


5.00 




5. Roles and responsibilities clarified 


5.00 


V.71 


l».82 



II. Satisfaction wTth the Needs Assessment 



1. 


NA met expectations 


'•.9't 


It. 50 




2. 


Usefulness of n^eds assessment 


5.19 


l».76 




3. 


Quality of needs assessment 


5.25 


i».68 




k. 


Overall satisfaction 


5.31 


1..60 


i<.88 



a - Describes the number of surveys used in the analysts where N « the number of 

surveys, and [ %] ■ the percent of all needs assessments for which surveys 

were available. ^ 

b - Means derived from ratings on a six-point scale, where I • criterion not met, 
3 • criterion met partially, 5 • criterion met completely, ahd 6 - exceeded 
stated cYFterlon. ^ . 

c - Means derived from ratings on a slx-poInt scale, where I • ynsatr5fiictpry# 
3 • average, 5 • excellent, and 6 « exceptional • 
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EVALUATIONS OF INOIVIOUAL TA EVENTS BY TA CONTENT AREA 
OEMONSTRATKIN PROJECTS 



1980*81 



Area Evaluated 



TA CONTENT AREAS 



. Child Parent Staff 

Services Services Oevt. . 

(N P (N « 7) (N - 12) 

I6kx,i fBQ%^ rioo?i 



Oeno/ Evalu- Adnin, 

Dissen. at ipn C Hgt . 

(N - 26) (N - 16) '(N • 19) 

r6o^i r89n fioo^r 



TOTAL 
(N « 3U) 



Overall QuaVtty 
o» t>^e Everts 

Standard 
Deviation 



5.00 
0.76 



<«.00 
0.82 



5.38 
0.6S 



5.29 
0.^*6 



<».88 
0.81 



5.15 
0,W 



5.06 



Overall Client 
Sat>sfact(on 



Hean 

Standard 

Deviation 



'♦.93 
0.70 



1.07 



5.23 
0.73 



5.29 
0.'*6 



t(.81 
0.83 



5.25 
Q.6U 



5.05 
0,75 



a - Ratinos obtained on a sU-polnt sctfle, where 6 ■ EKceptlonal, 5 ■ Excel lent, ^ ■ Good, 3 ■ Average, 
2 • Below Average, and^T"* Unsatisfactory. The sl*th point was used to obtain greater dlscrlnlna- 
tlon in the usually favorable ratings. 

b - Describes tha number of surveys usad in the analysis where N ■ the number of surveys, and ■ 
the percent of all services In that content area for which surveys were available. 
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were giv,en to services provided in the areas of Staff Development, Demons t ra- 
ti on/DIssem{ nation, and Administration/Management. Ratings^of quality were 

lower for those services related to Parents (X ■ A. 00). *CIi(pnt satisfaction 

* > .1 

was rated highest (again above **(Bxcel lent**) in the areas of Demonstration/ 
Dissemination, Administration/Management, and Staff Development. Agala,- 
lower ratings of satisfaction were given to Services for Parents OT ■ A.lA). 

When viewed from the perspective of the types of TA services, ratings 
of quality of TA were "excellent" or better for all services with the* excep- 
tion of reyiews and critiques and information services (Table 8). Highest 
ratings of quality ("excellent" or above) were given to visitations, on- and 
off-site consultations and small group TA meetings. 

Client ratings of satisfaction with the various types of TA mirrored 
^ho se of q u a^l+ty , with visitations, O fv - a nd a ff^'sit^^oii^lt^t^^s-^FKi-sma^ll— 
group TA meetings receiving the highest ratings. Ratings of "good" were 
received for Information services and reviews and critiques. 
Topical Workshop /Print Products 

Because these two types of services were provided to several types of 
projects, e.g., demonstration projects, SIGs and outreach projects, reactions 
to their quality are provided In Section 4, Other Servlees and Results , of 
this report. 

• .t 

Overall Results 

In order to determine the overall effectiveness of TAOS' TA to projects. 
Information was gathered regarding four areas: (a) change In the status of 
the TA needs Identified at the beginning of the year; (b) Impacts on the 
organization of the projects; (c) Impacts, on progranroatlc aspects of the 

34 



Table 8 



EVALUATIONS OF INOIVIOUAL TA EVENTS BY TYPE OF TA* 
OEMONSTftATION PROJECTS 



1990-81 



Area Evaluated 



On-site 
Consul t. 
(N ..53)^ 



TYPE OF TA 



Off-Site 
Consul t. 
(N . 7) 

CsoO 



Review/ Info. Visit- Smal 1 

Critique Service at ion Group TA 

(N-Z) («-J0) IN- 2) IN- 10) 

C78'^J [565^] l\00%} [\QQ%i 



TOTAL 



Overtt! Dual « ty 
of the Event 

Mean 



Standard 

Deviation. 



5.10 



0.73 



5-00 



d.oo 



'♦.71 



0.95 



0,95 



5.67 



0.71 



5.00 



0.<«5 



5.06 



0.7^» 



Overall Client 
Sat i s^act ion 

Mean 

^ Standard 
Deviation 



5.12 
0.77 



5.00 
0.00 



^•.57 
0.79 



i».7Q ^ 
0.95 



5.t»t» 
0.73 



5.10 
0.5<« 



5.05 
0.75 



a - Ratin9s obtained on a sIx*point scale, where 6 • Exceptional, 5 • Excellent, k • Good, 3 • Average. 
2 ■ Below Average, and I ■ Unsatisfactory. ^ r 

b - Describes the number of surveys used In the analysis, where H • the number of surveys and • the 

percent of all services of that type for which surveys were available. 
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« ' - • ' 25 7 ■ ■ . 

j>rpjects;_ and (d satljsfactipn with all of thp TA piH)vided. This 

Information was gathered in an end*of*year survey sent tq all projects^ 
Fortythree surveys, representing 81% of the projects and 93 of the 109 needs 
(85%), were returned and provide the basis for the information in the 
following sections.^ ^ 
Change injthe Status of^TA Needs 

Projects were asked to assess,, retrospectively, their state of devel- 
opment In relation to Identified needs prior to receiving technical assist- 
ance and to assess their status after all TA had been delivered. Figure 3 
presents the ratings before and after TA in graphic form. The projects 
reported that they had not begun to plan work prior to TA in 29 of the 93 
need areas (31%) and had planned but not begun to implement work in 32 (3^%) 

~bTthe need areas. A f t e r~teclTh i ca I a s sTst an ce , the status of the heed areas 
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had moved considerably beyond the original status with 59 needs (63%) at the 
stages of being Implemented or completed. 

To determine whether the change in status as reported on the end-of-year 
survey was statistically significant, a correlated f-^test was conducted. The 
mean of the status of projects prior to technical assi stance^ (1 . 8?) was com- 
pared to the mean of the status after technical assistance (3*A0). The 
result was a t-value of -14*38 (significant; at the ^0001 level ) indicating 
that the status after TA was significantly greater than the status prior to 
TA. 

Finally^ a series of quest ionsywas asked to gather three types of Infor- 
mation regarding the needs. The^r -elated to assistance provided to the 
project In the specified need area by persons or organizations other than 
TADS and project perceptions of tKe extent of TADS* contribution to their 
progress (Table 9). 
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Figure 3 



STATUS OF PfiOJECT MEEOS BErORC AND AFTfR TECHNICAL ASSISTANCE 
, (Total Number of Needs • I08) 
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♦ • Kepresents the number of TA Weds for projects responding to tlw survey. 
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Tabia 9 



tNFOKHATION KELATEI) TO CHANGE IN STATUS OF NEEDS 
OEMPNSTMTION MOJECTS 



1980-ei * 



> 



old you ractlva outildc atSi stance 












.Ho 


other than from TAOS dur'ing the year? 






'< • • ' « 




' T" 


H « 


^ ^ ■ ' i 

First Year 








9« 


25 


27* 


Second Yeer 








5 


14 


30 ee 


Third Veer 




\ 




7 


IS 




TOTAL 

~\ 








21 


S3 


72 • ^7 

2. 


From whom dfd you receive 

the esfistence? (If to 1) ^ 




Ind i viduel 
Consfflte^t 




Agency 


Other 




N 




N 


-* 


U 


F\r%t Veer 

Second Yeer ^ • • 




5 




2 


22 


2 12 




3 




1 


2C 


1 2^ 


Third Veer 




3 




. 1 


24 


3 ^^J 


^ TOTAL 




• 




k 


2? 


8 J£ 


How much esslstence did you receive 
les compered with TADS/ 7 


f 




%% Then 

TADS' 


Seme es 

' vtADS 


More tf>en 
TADS 




— r 






m 


u 


First Yeer 




• 5 




3 






Second Yeer 




2 


4C 


3 


ec 


• 


Third Yeer 


« 






ii 


67 


3 ' 


TOTAL 




7 


23 


10 


48 




Whet did TADS 
con'trlbute to 


Not hi no 


• (2) 
Some A 


' (3) - 

great deal 


Aver eye 

Contribution 


YOur oroqref »7 ' 


N > 


N 


. 4 


N 






First Yeer 


m * " 


■ 7 


29 


29 


B2 


2.8t 


Second Yeer 


1 J 


7 


tl 


25 


76 


2.73 


Third Yeer 


• m 


6 


27 ^ ' 


16 


73 


2.73 


TOTAL # 


• 

1 i 


20 


22 


70 


77 


2.76 


a ' '. «< ' 

Ntjnber of TA needs for which services were provided end detA evelleble* 
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Twenty-three percent of the projects receivedassistance in a need 
area from personr or organ izatN^^ther than JADSl Thir^yljar projects 
received the most additional assistance (32%) while seconcf-year projects 
received the least ' , 

When additional assistance was provided, it was by individual consult- 
ants, agencies and other persons 'or organizat^bns with individual consultants 

i,.,.. ' ' ' ^ . . .■ ■■ ■ ' 

most often used,. The assistance provided was more often the .same amount or , 

Jess than thatV provided by TADS. ' , / 

p . ' ■ ' ' ' . ■■■■■■ . ^ . 

To obtain ah indication of the effect af addi tional assistance, a t-testt 
was conducted comparing the change in status of heeds meank of those projects 
that received additional assistance (X 1 . 57) Wi th those that worked only \ 
with TADS (X = 1.78). There was not a significant difference in change in 
. status between th^ two. ^ 

I . . . . ■ 

Most projects (77%) bel ieved that JADS contributed a Qr6at deal to 

their progress J h the need area. 

■- ■ ' ■ ' . 

Organizational arid Programmatic Iniipacts, . 

In order to obtain an indication of the impacts of teqlhnical assistance 
on the project?, projects were a^ed on the end-of-year Sjjr<yey to rate a 
series of i tems clescribing potential organizational and| programma;tic impacts. 

Organizational impacts were defined as those areas which influenced a 

. .:' ... y 

project's overall organization and operat ion. They w<jre ndt; areas in whiqh 

, ., . . . _ . ^. ^. _ . . . .. _ . ^ 

technical assistance is often appl^^ed directly but rather'ar^as which tech- 
,nlcal assistance for program development, such as needs assessments, might 
affect. For this instrument, twenty-seven items were categorized into the 
seven areas of: (a) administ rations (decigi.on-mal<i ng , pol icy changes, 
program analysis) ; (b) staff (rpleS, knowledge/awareness, sicllts, attitude/ 
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morale); (c) program clarification (organizatron/clarif ication, goals, 

rjefinement); (d) program operation (resource identification, planning, 

Implementation, documentation, product development); (e), program support 

(administrative, recognition, funding); (f) benefits to non-staff persons 

(children, parents, oth#^ participants) ; and (g) relations with othgr programs 

or agencies (Interagency, assistance to others, information sharing). ^ 

Programmatic Impacts were defined as those specific content areps or 

adtivlties which characterize an HCEEP demonstration project. As in TAOS'' '.; 

descriptions of all of its services, the 26 items were categorized into the 

content areas of: (a) services for children (Identificdtlon, diagnosi'S/ 

assessment, Instruction, other agencies, d^ermi ning. effectiveness) ; 

(b) services for parents (introduction, Ihvolvement, direct services, other 

agencies, determining effectiveness); (c) ^ftaff development (introduction, 

implementation, determining effectiveness); (d ) demons t r a t i onZd I ssenfiLna 1 1 on/ 

continuation (planning, developing products , implementation, determining 
^^^^^^^^^^^^^^^^^^^^ 

effectiveness) ; (6) adm 1 n 1 s t ra 1 1 on /manag emen t (personnel, planning, finance, 
records/reports, advisory "board, interagency coordination); (^nd (f) evaluation 
(planning. Implementation, communicating/using results. \ 

Unlike organizational impacts , programmatic impacts encompassed, content 

, '■'-*■>.•. . _ ' .. . ' 

areas In which direct technical assistance was provided. The assistance was 

individual 1 zed for each project jni the services X)i^t1[0^ij^ 
^gVeiment and in Qthi^r^dl rect \%rvices s^u'ch as ne^ds asseslrftents, ic|dltional 
, TA aftd the Infant health care/education workshop. Percentage of impact must 
b4 interpreted with the knowledge that TA services In the areas listed were 
provided only If a spc^clflc need for TA In the-area was Identified, for 
most, If not all, of the Items, therefore, TA w^s provided to a percentage, 
not all, of the projects. 



30,, 

For each item, projects were. asked to Indicate the^ype of impact TAOS* 

TA had on their work by choosing one of the following: 

. ,1 ' ^ . ^ ' • .^-1, 

-3 " significant negative impact ' 
-2: • 'moderate negative impact 
-*l ■ lijfnlted negative Impact 
0» ntf impanel ^T* ^ -^ -^^ --^ ^ , 

1 « limited positive impact, . \ 

2 « moderate positive Impact 

3 "significant positive impact ' . 

^ repor^t and interpret thc ^vera^l 1 resu+ts^ two sets of figures were comFrtrted. 
The first was the percentage of impacts designated at any level, i.e., any 
rating other than zero. The secon^^ was the average or m^an of the ratings 
for those projects indicating an impact . For purposes of interpretation, a^ 
mean greater th«fn 1.50 and less t|ian 2i^00 was defined as a ''greater than 
limited'* impact. A mean greater thap or equal to 2.00 and less than 2.50 
was defined as^ an "obvious" impact. There were no means greater than 2.50 
for the general areas of ^impact for projects. (See Table 10 for the percent- 
ages and Appendix A for a table of the precise means fo^ projects. ) 

As indicated, tHe areas of greatest organizational Impact were program 
clarification and stjaff^ ^ (nipactS^ ^f^l^l^^t^^ §ssistance were indicated by 
slightly less than balf of the projects on items relating to external support 
for the program and benefits to non-'i^taff persons. When Impacts were indicated, 
they were strongest in the areas of program clarification (X « 2.11) and 
program operation ■ 2.03.)* The greatest number of lfn|]|act^ was reported by 
first year projects, while the greatest degree of impact was* reported by 'third 

year projects. > f 

< , , • . [ • , . " 

There were somewhat fewer ^incidences of impact in programmatic area^« > 



As mentioned previously, technical assistance was provided to projects Mn on 
those programmatic areas iq which technical assistance needs were identified. 
The area of greatest impact, tn terms of Incidence, was that of evaluation. 

42 . / , \ \ 
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table 10 



PERCENTAGE AND LEVEL OF TRACTS OF 
TECHNICAL ASSISTANCE AS INDICATED 
BY DEMONSTRATION PROJECTS 



1980-81 



ty/e of impact 



1. organizational 



PROJECT YEAR 



First 


Second 


Third 


Total 


(N= 1 1 ) 


(N=16) 


(N=16) 


(N-43 


- 


55%** 


61 %* 


65%* 




73%* 


73%* 


79%* 




71%** 


79%** 


80%** 


7B%* 


56%* 


7A%** 


68%** 


52%* 


38%* 


50%* 


A6%* 


58%* 


A2%* 


50%* 


. I»9%* 


k2%* 


kz%* ^ 


65%** 


" 50%* 


6k%* . 


30%** 


38%** 


M 1 %** 


58%* ' 


30%* 


39%* 


A0%* 


76%* 


A0%* 


60%** 


57%* 


5Z%** 


70%* 


76%** 


59%* , 


53%* ' 


36%* 


. AA%* 


A3%* ■ 


73%** 


65%* 


52%** 


62%* 



A« Administrdt Ton 

B. Staff 

C. Program Clarif i catTon 
0. Program Operation 

E. External Support for Program 

F. Benefits to Non-Staff Persons 

G. Relations With Other Progj^ams 

or Agencies 



11. PROGRAMMATIC 

A. Services for* Children 

B. Services for Parents ^ 

C. Steff Development 

0. Demo/Dissem/Continuation 
E. Administration/Management 
V F. Evaluation 



^The percentage figure represents, the percen| of prpjects indicating there to 
be an impact on the it;aris in each category. 

''Asterisks indicate the degree, of impact :FOR THOSE PROJECTS INDICATING AN IMPACT. 
A single asterisk (*) indicates rhor^e than a limited impact, i.e., +K50 to^4-l.99 
op a scale where +1 • limited Impact; 2 • moderate impact; and 3 ■ significant 
impact. A double asterisk ("^j^) Indicates an obvious impact, i.e., 2.00 to 2«A9 
<$n the same scale. (See Appendix A for a table of the actual means.) 
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Other areas in which impacts were noted quite often were demonstration/ 



dissemination/continuation and staff development. iFewest rncj^ehces af 
impact were noted in the area pf Services for Parents (^6%), Service? for 
Children and Administration/Management (431). While the incidence of 

impact was low, those who reported an Impact in Services for Children indl- 

' ( ■ ■ ■ ' . . 

c^ted it to be an obvious impact (X ■ 2.01). 

• . ' .ft 

In order to synthesize and Interpret the results for indl v'idu^r^ttems , 
additional criteria were established. Items which were rated as being an 
area of Impact by 70% or more of the projects were designated as areas of 
high Impact. Those which received 30% or fewer impact ratings were designated 
as areas of low impact. As indicated in Table II, high incidences of organi- 
zational impact were evident Pn the areas of administration^ staff, program 
clarification and program operation. There were no instances of low Impact 
according to the criteria. , 

Programmatic areas in which individual items were categorized as high 
impact areas were demonstration/dlss^ination/continuation and evaluation 
(Table -1?). All hi^h impact .Items were related to aspect^ of planning^ The 
prograirenat }c areas where the incidence of impact was classified as loy^were 
In obtaining services for children and parents through ^ther agencies^ 



Overal.l Project Satisfaction with JA 

The final question on the end-of-year survey sought to determine overal 1 
project satisfaction with the technical assistance received from TADS during 
the contract year. Two^ different scales were used. For first and second 
year projects a stjcpolnt scale, Identicail to that used to assess satisfaction 
with individual services, was used. For these groups^, first year- projects 
were tnore satisfied with all of the TA they received than second year projects 
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Table II 



AREAS OF HrGH ANrinnrOWrANTZATroRAL IMPACT 
DEMONSTRATION PROJECTS 1 980-8 1 



General ^f€a (Number oif Itemi^) 



f High Impact Items 



Low Impact Items 



1/ Administration of the 
Program (5) 

II. Staff (5) 



Ill- Clarification of t^e 
* Program, (3) 



IV. Operation of the 
Program (5) 

V.^ Support for the . » 
Program (3) 

VI. Benefits to Non* Staff 
Persons (3) 

VI 1. Relations with Others 

External to the Program (3) 



1. Decision Making (78%) 

2. Proqrani Analysis (82^) 

1. Staff Knowledge and Awareness (95%) 

2. Staff Skills (83%) 

•3. Staff Attitude/Morale (83%) 

k. Staff Understanding of HCEEP (78%^) 

'I. Program Organization (86%) 

2. Clarification of Goals (8l%) 

3. Program Refinement (80%) 

1. Resource Identification (86%) 

2. Documentation/Record Keeping (72%) 



(No items met. the criteria 
to be considered on area of 
low impact) 



The perceirage of projects that indicated that the item was an impact of TAOS* technical assistance. To' be 
considered ^high at least 70% of the projects had to have indicated the Item to have been an Impact. To be- 
labeled low the perce^tag^ used was 30% or less." ^ 
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Table 12 

AREAS OF HIGH AND LOW PROGRAMMAT If IMPACT 
DEMONSTRATION PROJECTS I98O-8I 



General Area (Number of Items) 



HigTi Impact Items 



low impact Items 



Services for Children (5) 



11. Services for Parents (5) 



ML Staff Development (3) 

IV. Oemonst rati on/01 s^emfnat ion/ 
Continuation (k) 



V. Admini St rat ion /Management (6) 
VI. Evaluation (3) 



I, Planning for Oemonstraj^WfT, 
Dissemination and/or 
Continuation (7^%) 



I. Planning for Evaluation {7Z%) 




I. Services from Other 
Agencies (22%) 

I. Services from Other 
Agencies (29%) 



the percentage of projects that Indicated that the Item was an impact of TABS* technical assistance. To be 
considered high at least 70% of the projects had to- have indicated the item uHhiave been an ifYip^ct. To be 



labeled low the percentage used was 30% or less. 
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(JT* 5.27 ?or first year projects; X ■ 4.87 for second year projects). 
Both means, however, were close to the scale rating df 5 or "excellent." 

For third year projects a diiffierent scale was u^ed. It was a seven 
point scale ranging from -3 for extremely dissatisfied to +3 for extremely 
satisfied. This scale was used to allow the data to be used in a special 
study of tethnicafl assistance. ' (The scale had been used for the previous . 
two years and was needed tb allow comparisons of overall satf^sf^ction across 
three years of project operation.) Resulting mean ratings for third year 
projects were also quite high (IT* 2.53)* 



Comments received from individual project staff members. on TA event 
evaluation forms provide additional information and insights into some of 
the factors relating to project satisfaction with TAOS' siervices. Host 
comments were very positive. A few negative or instructive comments also 
were made, A sampling of these for each type of TA follows. 

Many very positive comments were received concerning on'** and off'-site 
consultations: 

• (the consultant) was extremely well prep(ared and organijredl) 
It made it very easy to cover all the work that needed to 
be dofie. 

•the consultation was extremely task oriented, organized, 
and helpful. (The consultant's) high level of advertising 
knowledge and experience greatly contributed to problem 
_ soljgjja the^^p^^ demo/dtssem. needs of the project and 
_ "^-'•^'^-^pytftrif ^ plan Into action. He generated real enthusl- 
^ ^sm with all project staff to participate In the demo/ 
dissem. plan. Excellent facl 1 1ta/tlng. 

^ ^ . , > ' 

•(the consultant's) ability to focus on the Important fac- , 
tors In the project and to suggest ways of ana^lyzlng the 
data contained In these areas was very helpful and useful, 
(the consultant) was very pleasant. Informative and help* 
ful. In addition to the useful suggestions for the project, ' 
she made suggestions that were practical and likely to be * 
Ifnplemented for our total Infant program. 
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'•(the consultant) Is a most genteel and sensitive person. 
Both members of the staff served by his consultation 
felt that this was one of the most productive two days 
ever spent. 

•(the consultant's) expertise In audiovisual product 
development was especial 1y Important to us at this 
stage of our dissemination year. She was able to 
focus on aspects of our product that we had not con* 
sidered. Her Input assisted us In our decision making ^, 
process. She wa;s well received by our team^. She was 
an outstanding group facilitator who modelled beautf* 
fully how t^get the most from the creative resources 
of the team**slnce our need was focused on working with 
adults, she waS perfect**she ^trained us by providing a ^ 
model . ' • 

• (the consultant) was an objedtlve evaluator^ ' His 'ex- 
pertise In. program evaluation facilitated our awareness 
of options previously unkncswn^ ' He also provided a can.*^ . 
did appraisaV of our current procedures, which increased 
our' Insight regarding other ^evaluation procedures^ I 
recommend him as a competent prof ess lonal , and 
assume that other HCEEP projects could benefit tromyiis 
know 1 edge •' 



lures^ I 
id wdOl^d 
t fromVit 

\ 



•the presentor was %towledgfeble of the population served, 
and was able to refif to examples from her own expert* 
ences, which helped |N|aff to understand the content of 
^ the workshop presented^ * 

• explored and llst^sd various avenues for 0/D and ultimate > 
continuation funding^ Strengthened, greatly^, staff's 
understanding of b/D-~who to contact, how, when, whqr6^^^) 
, . ^ Lj beyond that which was known'. AJ.f Aspects of. the coi 
.sultatioh were excellent .anit^^sr^y useful • All was 
^ presented In a very Interesting and pleasant manneri 
Excel lent* « 

•this evaluation sounds like the halo^effect has taken 
control! } assure you that the assistance was out* 
• standing in every aspect and l*m not generally so 
I ' posit I ve^ , . . 

Projects m\so pointed out ways In which tonsulratlons could have been 

Improved. Although very much In th^ /ninorlty, the following suggestions 

and comments wei\ provided to TADS: 

•he was not that sensitive to the possibility of effective 
Intervention using behavioral methods based on develop- ' 
' mental principles* 
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• I found the consultation useful and helpful but in 
retrospect . It did not focus on the clearly spelled 
out objective of reviewing rigorous evaluation designs 
for determining child progress. I would have lilced 
. readings on design issues rather than on focusing and 
utilizing evaluatfonrahd a discussion of this. 

• ' ' Y"^* ' . ^ 

.time could have been utilized more effectively had the 
presepttr been more familiar with our program. 

Comment^ received from participants In small group TA meetings wer 
almost universally positive. Some typical examples follow: 

.good meet}ng--well^rganlzed--sensitlv7ty to individual 
program needs. ^ 

.provision of an '*array" of resource persons—affording 
* a comprehensive approach--di fferent Ideas for approach- 
' ing task. 




• each of the consultants had a special contribution to 
the group, both in materials and style that was useful, 
it turned out to be even more helpful than I antlplpa- 
ted"the time (number of days)^and proceduires seemed 
Just right. ^ 

.the Individual conferences with th^ consultant were 
particularly useful. He understands the unique con- 
tinuation problems we have,^ did a thorough job of 
reviewing all possibilities, was low key but well 
jDrcjanlzed and directed. The meeting was well organ- 
ized, the consultants well prepared for the consultsl- 
1 1 on, and obviously "knew their stuff." As usual, I 
-4^^-' VS6 ^ if np y fe gWTSy T1%^cWe1ehce; TTexTgl Hl^^^ahd 
warmth of all of the TAOS group..' 

Suggestions for change regarding small group TA meetlogs Included 
the fol towing: 

0 .possibly more review of bther project *s products with 

a critique, positive and negajtlve, so that we could 
•void common mistakes and tiirriphasl^e good points, etc. 

- .It might have been useful to use a complete case 
study of a project: cost analysis pt^n, Identl4?ylng 
^target audiences, showing analysis and f Irtal^roducts-* 
all the pieces were presented and could well be pulled 
toge\her In that way^; The first morning session covered 
materials sent for^ggested pre'^meetlng reading. We 
could have moved through that material a bit mbre rapidly 
est that was an "up*t1me" In terms of cnyergy. 

5i 
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Comments received for review/critiques were also primarily positive: 

<the followup phone Gall was appreciated and helped 
clarify some vague areas of the written response^ 

.very specific recommendations were provided.* Her 
- examples were also very helpful. 

.all of the information was extremely pertinent and' 
useful. ^ 

* ■» 

This comment provided information which may be useful to TAOS in . ^ 

Improving the review/critique procesls: 

•instruments were critiqued, pointing out shortcomings 
which have also been troublesome to me** I would have Y 
found this critique more he1(/fu1 If the consultant ^ • ^ 
had suggested alternatf^^e^lnstruments that she felt^^ 
would be more satisfactory^- 1 plan to telephone her 
to obtain ^addittonfl input from her in this regard. 

Vi si tattons to other programs for training or Information received the 

following typical positive comments: ' . ^ 

.the project director anji her staff were exceptionally 
helpful. '^They structured our visit to our needs. «^We\ 
left their center with a great amount of informat fon.-^ 
The trip was definitely, prof 1 table. ' ' " 

.1 was overwheliBed by the interest and helpfulness of 
their staff. I came back feeling JeSrs anxious about 
what I don't know and mor^e confident about What I do 
know. 

.the staff ^t the site were extremely helpful and will- 
ing to share Information with me. A great deal of 
thought and time was spent in organizing my visit . 
, enabling me to get the most out of it. I have enr 
closed a copy %f my schedule to show ^oa* 

r, ' 

No suggestions for. change In visitations were received this year. 
Informatlian services received a mixture of positive and negative com- 



ments. On the< positive side: 

• Information for^RlQed eliminated need for project to \ 
speWd hours to research material. Material sent was* 
direct» concise, andNpxtremely pertinent to project 
needs. J 
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.the variety of materials and. formats vrep resented 
, by the sample materials sent to us was most help- 

^ * ful. We were able to observ^organi^zatlon, 

attractiveness of packagr>s )i whole, langua^^"^ 

of ^the packages. ^ ' ^ ^ 

• lnfdr;mat ion service was provlde^d promptly. ^ 
, ^ Materials were well selected for relevancy of 

use. I « ' . 

On the negative side:* f 

• there were some questionnaires jthat were inap- 
roprlate for our purpose; however, they were 

I useful In giving us spme guidelines* ' 





in general the staff felt that the results of 
this ^information service was good and valuable. 
. TADS Information system searches appear to not 
have the resources to go far beyond the HCEEP' 
. network, howeVe'r. Often project staff is at 
' ^ least vaguely familiar with available Information 
, , * within ^he system. Developing some accesses to 
wider channels of information search might be 
additionally helpful. 

Convnents from the end of year survey provide a glimpse tff the project' 
reactions to al^ of TADS* Services, Including publications, addi t lonal TA, 
and ongoing Intefactlcfns with T^DS* staff. The following comments repre- 
sent typical positive comments dra^n from the survey* ^ • ' 

.we havb been most Impressed by TADS* selection' of 
nee^ssessors, consultants, tbeir thorough knplAfl* ^ 
edge Of the field of aval labia personnel and Iriistl- 
tutional ^resources, as well as with their flexibility, 
Intpr^st, courtesy and efficiency In handling all 
transactions* 

•the assistance provided through TADS to our project 
this year was Invaluable^ In addition to the tech- 
nical assistance specified in the Memorandum of 
Agreement, our project benefited from an 'Mnformal** 
type^ of assistance^ TADS personnel were always 
responsive to requests for information covering a v 
Variety of toplbs. The linkages we made as a result 
of TADS information have been helpful In our project 
developments 
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• our si te-visi t from (the consultant) was parti cutarly 
useful in terms of^ the Stated need, but Also gavd^s 
the opportuni ty to analyze other areas such as: team 
functioning, deffnitfon of rples 6 tasks, ?taff devel- 
opment heeds. Appropriately, we functioned more auton- 
omously Jn our second year, but were very well supported 
by TAD,S. If our ci rcles are not at I "exceprTonar', it 
Js not a criticism of the assistance aval lable, but of 
our growing securi ty. Thank youli 

.the TADS people have been wonderfully supportive of my 
> rble in this .first year and helped ease my transition 
. fnto the directorship. The consul tants they provided 

'^'y^&.. were excellent and have made a significant difference 

In. the operation of the project. I have appreciated ^ 
thei r role and look forward to ahother year of asso- 
: ; elation wlt^h them. ' 

.Ilnilted assistance was at our choice this year, but I 
am ext r erne 1 y i mp re6s ed with TADS. You've given, support 
& service whejwieeded £ your help has been excel lent ! 
I especially l^e your books and newsletters that are 
sent to us. Keep up the good work. 

Projects also provided TADS with specific suggestions for change, as 

exemplified by the fdllpwing survey comments. , 

.consultants s,hould have much more practical information 
^ and fami 1 iarization wi th project prior to arrival. 

.my comments about this year' s consultant are extremely 
positive; however when I look at the year as a whole I 
am disappointed in what t received from' TADS this year.., 
I missed having a consultant come on site in the, fall 
to guide us in the needs assessment process. com- 
pleted the seilf-assessment this year, and it would have 
been much more valuable to o|ur itaff (and to me) if an 
outside consultant had been the group faci 1 i tator' of 
that. . I had 8 new staff members out of 12 on the team, 
£ the TADS-conducted assessment could have helped the 
new st£)ff recognize the difference between model devel- 
opment and service delivery. recommend that TADS 
drop the self-guided assessment procedure and suggest 
; that 3rd year projects have an outside consultant, too-- 

One project director summed up her reactions to TADS' TA in the third 

year of finding and its impact over the three year I4fe of the project. 



vaithougTi I hav^^^ frequently on this 

evd}uat{on> I am not implying any negative results in 
working with TADS this year. Staff* were always friendly 
and helpful 6 my project was tneluded in many^TAOS 
aetrvities. 1 wais disapp^Qinted however, that, my needs 
Wef-e not addressed more fully. I realize that my needs 
fell under a category of refifiement & not development 
6 so I can see how they were not prioritized. To end 
on a positive note^ I realized in. goinig through the 
form, that the reason TADS had "no impact** on many of 
these measures is because during theCfirst two years 
of this demonstration project TADS had a "significant 
impact" inmost areas & helped the project become what 
it is today. \ very.much apjpreciate being included by 
TAOS in their recommendations to other projects S con- 
sulting with them as well as providing information for 
your future publications. It was a meaningful three 
years. 



SECTION 3: JECHNICAL ASSISTANCE TO HCEEP 
STATE IMPLEMENTATION GRANTS 



Services Delivered 



Thirteen states in the TADS servJce area received funding from SEP. for 




State Implementation Grants (SIGs) from Septemb^Xl , I98O through August? 31 f 
1981. light were in their first or only year of funding and five were 
second-year SIGs. ^ 

TADS provided a variety of teci;inica] assistance activities to the SIGs, 

as specified in the contract with SEP and described in quarterly progress 

i ■ ■ ■■ 

tetters. These included: /{sTa comprehensive program review to determine 
pro9ram status and needs/ f or technical assi stance; (b) development of 
Memoranda of Agreement and provision of technical assistance as outlined i.n 
the ^reements; (c) additional technical assistance in response to unexpected 
SIG needs and requests; and (d) the provision to SIGs of the newsletter 
Emphasis and other publ ication^. 

As was done for demonstration projects, services delivered to.SIGs w|^re^ 

< ■ ' j • ■ 

categorized as Needs AsseS|5n?ents, Memorandum of Agreement Services^, Other 

• ■ ;^ ■ ■ ■ 

Services and Print ProdMcts. Data were gathered regarclrng the nugiber of 
services provided, the iVbnl^er of SIG related staff participating in the 
technical assistance, the J.ength of the technical assistance s^rvide and 
the person(s) who conducted^ the servfce. 

Total Services ' <, ' ' ' v.? 



A total of 238 techhicat assistance £ierVfces were provided to SIGs, 
with an iverage of 18.31 services provided per SIG (Table 13). Of these. 



Table 13 



TAOS "TECHNICAL ASSISTANCE SERVICES DELIVERED 
TO SI6^ FUNDED FOR l980--8t«(ll • 1^) 



Type of TA . 






TA CONTENT AREA 






TOTAL 


AVERAGE- 




Program, 
Oevt/Mjmt. 


Evalu- 
ation 


Personnel 


Inter- 
aqencv 


Comm/ 
Olsscm. 


AH 
Areas 


1. Needi Assessments (N « 13) 




- 






. - - 


13 


13 


LOO 


2. Mcfnorandun 6f Aoreement 
Services (N ■ 13) 


















On-site 
Consultation 


6 


3 


5 


3 . 


6 


• 


'23 




J 

Off-S;te 
Consultation 


2 ^ 


2 


2 


— 






7 

• 


6.54 


V few 0>iU 

CrI t ique 


3 




1 


1 . 


- J > 




5 


• 0*38 


Information • 
Service 


9 






2 






18 


1-38 


Visitation 


1 




• 


1. 




• 


2 


0.15 


Sma 1 1 Group TA 


5 






2 


3 


• 


10 


0.77 


Conference*Workshbp 
- Presentation 










2 


• 


10 


0.77 


Other 


- 






1 






1 / 


0.0*^ . 




26 


e 




12- 




- 






3* OxHer' Services ,(N ■ 13) 
* Additional TA 


















. 6 






3 


6 




19 


1.46 


Tpzal 


















4. Print Products (N ■13) 


















Newsletter*^ ^ 

> 








» • 




39 


39 


3. 00 


Publications^ 


78 










13 


91 - 


7.00 


Total • ' 


T 










.52 


no 






'ALL SERVICES (N • 13) 

* 


no ,\ 


6 


24 


15 


«8 


^5 


238 


18.31 



a - This table does not include' the orientation workshop ^held in September 1981 for 1981*82 SIGs, or the 
September 1980 orientation workshop ^ which was reported in the 1979*80 evaluation report. ^ 

b Represents three edftf4ons of the newsletter EMPHASIS. . , 

e - Represents all publ fiatlons developed and distributed during this contract period, 



thirteen (13) were needs assessments, seventy-six (76) were services out-, 
lined In the Memoranda of Agreement, nineteen (19) were additional TA and 

onp-hund red thirty (130) were prlnt^ products. :c: 

. . ■ . ^ ■ . . ■ ■ 

\ A total of 3^7 i Instances of S^G staff and other related personnel 

involvement in tridtvidual ized TA were recorded, with an average of 3.5i» 

Staff involved per Individual iz^ed event (Table Ift). An additional 275 

persons were invblvfed In large i^^onference or workshop presentations, making 

a total of 622 S 16- related staff involved In TADS' technical assistance. 

This represents an average of MjAs staff /clients per direct technical) 

assistance event, including large conference or workshop presentations. 

The largest Involvement Was in^the content areas of Personnel Training, 

Interagency Coordinat ton/ Program Oeve I opment /Management and Communicationr/ 

Dissemination and the Services of Conference/Workshop presentation and on-" 

site consultation. 

A total of 159.04 days of technical assistance were provided to SIGs, 

for an average of .12.23 days of technical assistance per SIG and 1.^7 days 

per each direct TA event (Table 15)* The greatest length of time per event 

was spent in technical assistance in the content area of Evaluation and in 

the TA services of off-site consultaHons and a special service provided by 

NASDSE to a SIG (labeled Mother")- ^ 

/The technical as Si stance was provided primarily by members of the TADS' 

- ■ '. * 

staff and, consultants (Table 16). TADS' staff members conducted all but one 
of the needs assessments and provided all information services and additional 
TA. Consultants provideiS the majority "^of on- and off-site consul tations, 
visitations and conference presentations. 

Specific Services ' i L—,L 

Needs Assessment. Needs assessments for SIGs include a comprehensive 



TOTAL AND A^fRAGE HUMStfl OF SIG STAFF AND OTHERS 
PAKTICIPAnltG dlRECTLV IN TECHNICAL ASSISTANCE ACTIVITIES / 

1980-81 ' ' ' . ' 



TVbe of TA *u 






TA CONTENT AREAS 






TOTAL^ 

J: / 


Program 
Devt/Mgmt . 


Eva lu' ' 
at ion 


Personnel 
Trairiing ^ 


Inter* 

agency 


Cdfran/ 
DissemJ. 


All 
Areas 


1 

Needs Asserssment • 

Memorandum of 
Acreemeni Services 


4 






(■ 




25 
2. 92 


25 


On-site 
. Consultation^ 






AO 


17 - 


39 

f. 5i? 


- . 


169 


Off-Site 
Consul tat i6n 


6 


8 

4.00 


2 




1 




17 

2. 43 


Review and 
Critique 


3 




1 


k 

' 4.00 




- I 


8 


Information 
Service 


5. /J 


r 


8.' 
2. CO 


3. 

l.SO 


2 

'l.CO.^ 




60 

V. w 


Vis* tat ion . 


1 

: . so 


- 


- 


1 




- 


2 


SfNal 1, Grodfp TA 


t 7 


- 




2 






13 

J. j; 


t shop Prcseneation 


- 


- 


230 


22. ^: 


- 




275 

27. i: 


Other 






t 


1 


. - 


✓ 


! 

^ '0 • 


Other Services 


• 














A4<f1 1 i ana 1 TA 
^ !■ . ; J — 


■ • 8 
J. 33 • 


- 


12 


7 


25 
4.2? 


- ■ 


52 


TOTALS 
















Individual 1 zed 
Services 


135 

4.22 , 


18 


63 


35 


71 
3.94 


25 

1.32 


3^7 


Conference Work/ 
shop Presentation 




<• 


230 

2e.?s 


^5 

22. SO 






275 

27. £0 


All Services* 

AVERAGE^ - > 


'>. 

135 
4.22 


18 


293 

12.21 


80 


71 


25 

2.92 


622 




AVERAGE NUMBER OF SIG RELATED PERSONNEL RECEIVING DIRECT TA (N 


•13) 


47. Sf 



a - Represents the total number of SIG staff from all SIGs who participated In the activity listed, 
b ^ Represents the average number of #11 SIG staff who participated in the activity, 
c • Represents the average number of participants per SIG for al2. sei'vices. Individuals were counted 
each time thity p^artictpeted in a TA service. 
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Table tS 



TOTAL AND AVERAGE NUMBER OF OAVS OF DIRECT TECHMICAL 
ASSISTANCE PROVIDED TO S1GS« 

1980-81 



TA CONTENT AREAS 



Type of TA 

• 


Program 
Devt/Hgmt. 


Evalu- 
ation 


, Personnel 
Trai ning 


Inter- 
agency 


Comm/ 
Dissem. 


A1 1 
Areas 


TOTAL^ 


Needs Assessment 


• 










14.13 


14.13 


nef*K>randuni of 
Aoreei^ent Services 
















On-site 
Consultation 


13.75 


15.00 

- e.oc 


15.25 
J.. 5 


6.25 

2» 8 


20.25 * 

2.2$ 


- 


7C.50 


Off-Site 
Consultation 


i..63 
2.22 


11.00 


9.1J8 




.0.63 


- 


26.14 


Critique 


2. SO 


- 


0- 75 


1 . 00 ^ ; 

2.CC 






6.25 


Infornatton 
Service 


^•■33 

C. 4B 


0.50 

o.s: 


1.63 
0. 42 


0.50 


0.75 

^0,23 


- 


' 7.76 

:.42 


y^*^ Visitation 

Snal 1 r*r QUO TA 


1.75 

1.7S 

9.00 

* r * 


- 


m 

\ 


2.00 

2.:o 

1.63 


5.63 
J. 55 


- 


3-75 
16.25 - 

:.€2 ■ 


Con fere nee /Work- 
shop Presentation 




- 


3.13 

:.3? 


3.50 




- 


6.63 

r. 


Other 








3.50 

m 






3.50 

c.iO 


OtHer Services 
















Additional TA 


1.5P 
0. 21 




0.88: 
J. 22 


0.75 


1.00 
0.2? 




4.13 

22 


TOTAL^ 


19.51 


26.50 


31.52 • 


19.13 

2.28 ' 


28*. 25 


14.13 

2.09' 


159.04 




1 


AVERAGE 


NUMBER OF DAYS 


OF TA PER 


SIG (N » 13) 







• This does not includt time spent by TAOS staff in facilitating TA. It jdoes. however, inclutie preparation 
time for the TA provider, i.e. , TADS staff and/or consultants. 



b - Represents, the total nurtber of days in which SIG staffs participated in TA. 
c - Represents the average number of days in which SIG staffs participated in TA^. 
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Ubte 16 

TYPE OF TA PROVIDED 
$IGS 



Type of TA 



PWVIOER 



TADS 
Staff 



TADS 
Consultant 



Other 



Needs Assessment 

Memorandum of 
Agreement Services 

On-SI te ' 
Consu I tat (on 

Off-Site 
Consultation. 

Review and 
Critique 

In format Ion 
Services 

VIsUat ion 

Small Group TA 

Conference Work- 
shop Presentation 

Other 

Ot^er Services 
Add{tiona^ TA 



ALL SERVICES 



N 
12 



2? 



3 

18 



2 2C 

} i: 

28 37 

19 200 



N % 

1 8 

IS es 

2 47 

2 ::: 



33 43 



59 SS 



34 32 



U . 27 



b: 



I .i;: 



15 24 



a - Ihcludes servleas provldtd by combinations of groups such a« NA50SE, TAOS, WE5TAR. SEP and/or 
consul tantSf ' 

* \ * " % 

b - Parcentage of all servlcas provided* 
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review of the goals and objectives of the grant. Identification of areas 
which require major attention diirlng the current ^ear^ and Identification 
of ways In which TAO§' TA mIgKt help the S 16 reach Its objectives. All 
thirteen SIGs received needs assessments. On the average, almost nine 
hours were spent by the needs assessor and SIG staff in completing the 
needs assessment. On the leverage, two SKj staff members and/or other 
related personnel were involved in the process. 

A total of technical assistance needs were Identified during the 
needs assessments. The majority of needs were In the content areas of 
Program Development and Management and Personnel Training (Table 17)* SIG 
staffs most bften needed Information and assistance in planning. 

During the year eight needs were cancel led and two needs were added. 
Technical assistance services, therefore, were provided to address thirty* 
eight (38) needsf. 

Memorandum of Agreement Services . Services provided to SIGs under the 
Memoranda of Agreement Included on* and off^slte consultations, review/ - 
critiques. Information services, visitations, small group technical assist* 
ance meetings and conference/workshop presentations. Seventy*six such 
services were provided, with the most common types being on-site consulta* 
tlons and Information services. By contrast, the services labeled ''other," 
visitations and rey lew/crl t Iques were provided Infrequently. Consistent 
with the TA needs Identified during the needs assessment, a large number of 
services were In the content areas of Program Development and Management 
(3^%) and Personnel Training (26%), 

A total of 270 SIG staff members and/or other related personnel were 
Involved In tlie services specified In the agreements, for an average of 3.55 
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Table 17 



FREQUENCY AND PERCENTAGE OF NEEDS IDENTIFIED BY 
CONTENT AREA AND TECHNICAL ASSISTANCE NEEDED (N - 13) 

SIGS 



1980-81 



Type of Need Frequency and Percentage 



CONTENT AREA 

f 

Program Development/Management — 22 



Evaluation 
Pertonnel Training 



Information 



Revisions/refinement 



a - N ■ number of needs. 



_f_ 3 

% 7 

f 16 

% 36 



Interagency -g— 

f 5 

Comngunlcatlon/Dlssemlnation 
TECHNICAL ASSISTANCE NEEDED > ■ ' 

^ f ' - 
Decision-malting -j— 

Planning , -y- 



f 19 



f 2 

Skills/competencies ' -j— , ^ 

Product Development . f 8 



f I 



Program Development f ^ 

» ' 9 
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A ■ 

Staff members and related personnel per service. ^'(These fj^ures do not 
Include conference/workshop presentations In which large numbers of persons 
from a state were In attendance.) The greatest number of ^personnel wece ^ 
Involved Jn on-site consultations (7.35 Staff per event), with the hlghest 
number involved In events related to Program Development and Management, 
Personnel Training and Communlcatlon/Olssi^mlnatlon. k 

The lengthiest *A services were off-site bDnsoJtatlons (3.7!^ days), 
the special services provided by NASOSE (3.50 dayV) And on-site consultations, 
(3.07 days). Those of shortest duration were Information services (.^3 days) 
an(| conference/workshop presentations (.66 days)^ 

Host services specified In Memoranda of Agreement were provided by TADS' 
staff (37^) or consuFtants (^3%) , with the remainder (20%) provided by NASDSE 
or combinations of resource pepple. 

Other Services . TADS provided an average of 1.^6 instances of Individual 
Ued additional TA per SIG, or 19 services. This additional TA Involved &n 
average of 2.7*i SIG related persons perNesi^mf, and tpok an average of approx- 
imately two hours to complete. The majority of additional TA wa^ provided I 
Program Development and Management ^ind Personnel Training, and TADS' staff 

members were always the providers. 

•I 

Print Products . All SIGs were sent three Issues of Emphasis and ^he 

seven publications sent to demonstration projects (see the list In jS^ection 2). 

* - « . 

SIG Reactions td Services ^ 

As was true for projects, data were gathered to obtain the reactions of 
SIG persdnnel to TADS' direct technical assistance services. (Additional TA 
was not evaluated. The reactions of SIG clients to Emphasis and other publi- 
cations are repdrted In Section k of this report.) 
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Needs Assessment 

All SIG needs assessments were conducted with a needs assessor who 
was a current or, In one case, former member of the TADS' staff. Three 
re conducted at the September orientation meeting. Nine were conducted 



r 



on-site oi( in the TADS* offices. One was conducted b^ phone. Needs assess*? 
ments were evaluated in three primary content areas: (a) the extent to which 
tH^crlteria for a n^eds assessment were. met; (b) the ^eeds assessor; and 
(c) general satisfaction with the proces^. 

Table 18 presents a summary of the results of this evaluation.' Overall, 
SIGs reactjd very posi^vely to all aspects of' the .needs assessment. EspS* 
cially high ratinigs were obtained for the Identification of TA needs and 
^^^ctiVities and the flexibility and interpersonal sl<ill of the needs assessors 
All mean ratings were '5*15 or higher indicating that SIGs viewed the needs 
assessment in a very positive fi^shion. 

Memor^andum of Agreement Services 

Clients rated the qualify of TA service^, near'or above "excellent'' in 
all content areas, with total me«ns ranging from 4.75 to 5*60 (Tab|e 19)* 

The highest mean quality ratings were obtained in the content areas of 

• r ■ 

Comp)unication/Dissem{n,at ion (5«60),, PersonneU^Traintng (5«3l},''and Program 
Development and Management (5.30). The total mean qualtty rating |*as 5.2^," 
or above a rating of "excellent." Ratings of satlsfactlofr with TA were 
similar ,Seo the quality ratings, ranging from A. 71 to ,5/60r Again, -'the high- 
est ratingis were obtained in Communication/Dissemination (sLSO) and Personnel 

Training (5.31 )• The total mean satisfaction Was 5.16, or agaln-abovs 

> > 

"Excellent." v 
^ The client reaction Was also -analyzed according to types of memo* 
randum of agreement TA services* as shown, pn Table 20. Information services^ 
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Table 18 

MEAN RATINGS OF SI6 OPINIONS OF 1980-81 
NEEDS ASSESSMENTS (N '=13) 



Item 

The Needs Assessment Process 

1. Provided comprehensive review 

2. All needs Identified 

3. Technical assistance needs specified 

k.' technical assistance activities Identified 
5. iloles'and responsibilities clarified 



.Mean 

5.15 
5.23 
5.62 
5.5A 
5.46 



The Needs Assessor 

1. Preparedness 

2. Expertise 

3. .Organization 
^ k. Flexibility 

5. Ability tq relate to staipf 

I 

Overall Satisfaction «- 



5.42 
5.31 
r5-38 
5.77 
5.62 

5.46 



a - Ratings obtained on^ sIx-poInt sca^le, with 6 being the most positive 
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EVAlUAtlOHS OF' tH&IVIOUM TA EVENTS BY TA (joNTENT AREA* ' 

SIGs \^ m 

I980-8I ^ 



■• /' - 

. V f 
.. . •-• , • ■ t 

,->■ ■■; • /. ■ / 



Ar«4i Evaluated 



TA CONTENT AREAS 



og ram 
Dtvt/Hgmt. 
(N • 20)b 
C77i] 



Evaly 
• tlon 
(N - UY 

[67^] 



Pt rtonne I 
Training 
(N - 13) . 

C65>I 



Ihttr- 
•gencv 
- 7) 



Convn/ 
OI«*em. 
(N^ 5) 



TOTALlfe 

(N - 

[56<] 



Ovcral I QuaM tv 
of t^t gvtncs 



Haan 

Standard 
Dtv I at ion 



5.30 
0.73 V 



'♦■75, 
1.26 



5. 31 
0.95 



5.00 
0.82 



5.60 
0.55 



5.2i» 
0.83 



QvtraM CHent 
Sat i t^act ton 

Htan 

Standard 
Otviat (on - 



5.20 
0.83 



J»,75 
1.26 



S.3I 
0.95 



'».7l 
0.>6 



5.60 
0.55 



5.16 
0.87 



a • Ratings dbtalntd on a sln*polnt tqalt. whart 6 - Exctpt tona I .< 5 ■ EjiceMtnt, k ■ Good. 3 ■ Avtragt. 
2 ■ Balow Averagt, and"i ■ Un»at I ifac<ory. Tht, »l«th point wa» addtd to obtain gr#attr difcrlmina- 
tlon Jn tKa usually favorabit ratings. 

b - Dascrlbas tha numbar of survayWusad In tha analysts whara^N ■ tha numbar of survays, and f , % ] • 
tha parcant of all sarvlcas In hut contact %r%% for which surveys were available. 
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Table 20 
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EVALUATIONS OF INDIVIDUAL TA EVENTS BY TYPE OF TA' 

SIGs 

1980-81 : S 



TYPE OF SERVICE 



Area Evaluated 



bn-Site Off-Site Review/ "info. Visit- 
Consult. Consult. Critique Service/ ation 
W-IS** N = V N=2 N = 13 N=3 

i57%]t. E'»0^] 172%] i, [100,%] 



6raijp TA 



Conference ^ 
Presentation 

N = 8 

[80%] / , 



TcjTAL 

N - 

tS6%] 



Overal I Qua I i ty 
of the Event 

■■■■ t^.-..- 
Mean V 

Stan da 
beviatllh^> 

' ' '\ 

Overalol CI lent \ 
Satlsfactfon 

Mean 

Standard 
Deviation 



5 ,20 
0.9*1 



5.07 
0.96 



5.50 
0.58 



5.50 
0.59 



'1.5b 

0.71 



^1.50 



0.71 



5.5k 



0.66 



5.62 



0.65 



5.00 

6.00 



5.25 
0.96 



^1.33. . 5.00, 



0.58 



0.82 



5.00 
1.07 



5.00 
1 .07 



5.2*1 
0.83 



5; 1 6 
0.87 



ir^-lJatTn^T^raTni^ a s^wc-polnt sWTtT where 6"SS°TxceptioffalT5 Txc^lent , € =f Good, 3"»': AveVagli^^f 
2 » Below Average, and I = Unsatisfactory. , i 

b - Describe^ the number of surveys used In the analysis, where N = the numbet of surveys and [__/_%] = "the 
percent of all 'services 'of that" ty'|)e for which surveys were Available.' • * • 
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• • ... ... : , / 

on^ and off-site consuttat ions and smarigrpMP TA meetings received the 
highest ratings of quail ty/ whi le reviews and critiques were r^Tted some- 
what below the **Excel lent" scale point. Ratings, of sat IsjFact lon.were 
similar to qua 1 1 ty rat Ings for most services with the exception of those' 
for visitations which were somewhat lower. 



i 
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• * 5 QveralH^esul ts ^ > 

■ . ■ •• . ■ 

•i . ' . • 

This, portion of the report presents /nformat ipn obtained from an erid- 
of-the-year survey distributed to SIGs as TA was completed. Information 
was requested concerning the status of the SIGsVTA needs, TADS' contri- ^ 
bution to their progress in the TA need areas, TAOS' impact on prgani^a- 
tional and programma'tic aspects of tJher r^^prTogrgm and their; overal 1 sati s- 
faction with. TADS* TA^ Information l^presented* in this section for the 
nine SIGs (69^) responding to the survey as a group since the N's by year ^ 
of finding were too small to allow meaningful interpretations of the results. 
Change^n the Status of TA Needs ( / ^ 

SiGf clients were asked to assess the status of each TA need by rating, 

{ •. . ■ ■■ 

retrospectively, the\status of the need before TA and then rating the current 
^ status. ^The left-han^ of Figure 'i displaysUhe frequency of ratlnp 

obtalnedjfor beginning status. Twenty- six p^ei^ce^t of thj| identified tvfpty- 
seven TA ^needs for which data were available were in the^pre-planning s^age 
when the needs assessment wa6 conducted. The majority o^ the needs (56^)^ 
related to tasks that ha^d been planned but not yet Implemented. The remain- 
ing needs (17^) were for assistance in implementation. 



4 



\ 



Pirobress toward cowfrtet iom of the tasks Identified ^as TA needs is dlsr 
played oh the right-hand side of ^Figure ^i.^ Hal f of the^^heebs had 'elthir 
been completed or had most activities Implemented. Activities in the 
remaining need areas had been planned or were in the beginning implementa- 
tion phase.- ^ 

To determine whether the change in the need status was statistically 
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Figure k 



STATUS OF SIC NEEDS BtFORE AND AFTER TECHNICAL ASSISTANCE ' 
' (Total Number of Needs " 31) 

1980-81 



.Number 

of 
-^Needs 



0 



30 
?« 

22 
20 
18 
16 
Ik 
12 
10 
8 
6 
k 
2 
0 



Before Technical Asststanfce 




T — 



Had Not 
Begun 
to Man 



Had Concep- 
fualUed or 
Planned 



Had Begun 
Implemen- 
tat ton 



Ha4 Imple- 
mehted Host 
ActlvUtes 



Completed 



<»> C2) (3) Ik) (5) 

- Iteprc9cntt,tlie number of TA needs for SIGs responding to, the 



Number 
of 

Needs 



30 
28 
26 

20 
18 
16 
1^1 
12 

to 
8 

^6 
4 
2 

4 



3. 



survey. 



After Technical Assistance 



1 



a., 



Had No^ Had Concep 
Begun ^ 
to Plarf 



^ tual tzcd or 
Planned 



Had Begun /Had Imple- Completed 
Implemen* ^mented Host * ^ 
tatton Activities V 



(t) 



(2) 



(3) 



(5) 
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significant^ a cori^elated t-test was conducted comparing the mean of the* 
status of SiG needs prior to technical assistance (X « 1.77) to tfhe mean 
pf the status after technical assistance (yi ^ 3.27). The result was k 
t-valiie of -6.71 which ^as significant at, thfe .0001 le^el- - 

So* that we might understand the information about need status more 
^ clearly^ a series of questions was asked related to other assistance the 
SIGs received and TAOS* contribution to their progress. The results for 
these questions are prefsented ia Table 21. * ' , 

r TADS was the only provider of outside assistance for half (lA) of the 
TA needs during 1979-80. For those thirteen need areas where other outside 

assistante was used^ outside consultants and other unspecified resources* 

■ ■ • ' ^ " ■ ' ' 

were used. Additional sources usually provided less assistance to SIGs 

* ... 

than that provided by TADS. ^ 

In order to obtain an Indication of the effect of additional assistance, 
a t-test was conducted which compared the change in status of needs means 
for SIGs ob.taining other outside assi stance (X « 1.85) with SIGs working^ , 
only with. TADS (X « 1.69). The results (t « -.3602) Indicated that there 
was, nof a slgniffcant difference In progr^s^* related tt> needs^ betyeen those 
receiving other assistance ;and those workling only with TADS* ? 



" When ^sked hoW mudh TADS had contributed to Overall progress in the TA 
need aVeas, SIGs Indicated, that TADS* contribution had been substantial for 
6S% of ithe needs, and/that TAOS had made^ a^e contribution to prcigress in 
the remainder of the needs. 

Organizait ionaJ and Programmatic impacts of Technical Assistance 

In previous years, In order to determine the organizational and prograrn- 
matic impact of TAOS* TA on SIGs, SfG staffs were asked to rate, on an end- 
of-year survey, a series of Items similar to those seni to demonstration 
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Table 2t 



INrOKHATlON' RELATED TO CHANGE IN STATUS OF NEEDS 
SlGs 

1980-81 



1. Did you receive outside assistance 
other than from TAOS during the year? 



Yes 



No 



First Year ' . 






8* 62 


5* 55 


Secbnd Year 




* 




9 64. 


\\ ; TOTAL 






13 ' 4d 


14 £2 


Assistartce? (Ifyes.to^O 


Individual 
Consul taM 


An 

Aqe'^cy 


Other 




N 




N t 


N % 


^j^^ First Year 
Second Year 


1 






7 7P 


1 


20 




u ' ' a; 


•TOTAL 


2 


IS 




II fff 


. '-^ \ 

3. /^OM much assisitance did you receive (jis 
" jfomparcd with TADS )■? ( If' yes to. il'l ) > 


' ; Le»s Than 
TADS 


Same' as 
TADS 


'1' '■ 

Ho re (.Than ' ■ 
TAOS 


. N 




N % . 


■„ N.> » 


/ \ T Ti ^ — f 

^ , First Year' ^ \ 




8S 




< 

2 ' ' 40 


Sccohd Year f 


2 


40 


1 ' 20 


, TOTAL .< 


7 


64 


\ 9 


3 / '2? 


<r>*. yhat dfd TADS (1) i 
contribute to , Nothindt 




X2) 
Some 


< 

(3) 

A qreat deal 


K ■ 

1 * 

Average ; 

Contribution 


your prdg^ass? ^ N » 


N 


% . 


N % 


. / 


F«r»t Year - • 


3 


23 


ID 77 


2.77 


Second Year ' • • 


1 


7 


13 93 


2.93 


TOTAL - - - 




^5 


23 8S 


2.8^ 



N • Number of TA ncads for which ttrvletf Mr« provided and data M«r« available. 
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projects. Conments frcjm SIG staffs over the past three years have tended 
to suqgest that the format and number of Items were too cumbersome and that 
many of the Items Were ndt appropriate to the variations Tn SIGs and the TA 
they received. For these reasons, the format was changed to an open**ended 
one. SIG staffs were asked to clescrlbe positive and/or negative Impacts of 
TADS' TA on: (a) their SIG program and staff;, (b) tijeir State Education 
Agency; and (c) other Individuals, agencies or groups. A summary of SIG 
comments Is provided In Vablfe 22. As shown, the greatest area of Impact 
was In program clarification and operation (67% of those responding). 
Other high areas of Impact (over 50%) were the support given to SIG programs 
and their staffs, the enhancement of planning efforts, and the enhancement 
of the SIG's effectiveness. 

Overall SIG Satisfaction whh TA 

The final Item on the SIG survey asked SIGs to rate, on a sIx-poInt 

scale, their overal T satisfaction with all of the technical assistance they 
had received from TADS. The overall mean rating was 5-58,' Indicating that 
SIGs were, on th^ average, very satisfied with the TA they' recel ved from 
TADS 1n 1980-81. , ' 

A review of the comments on TA event evaluation forms from SIG clients 
provides additional Information to support this level of satisfaction with 
TAOS' services. Following Is a sampling of positive and Instructive comments 
' On- and ^off-site consul tat lonfs were general lyWery positively received 

0 

by SIG clients, who commented as follows: 

.the ten-point Issue/task approach resolution was 
^. particularly helpful to participants In clarifying 
' direction and scope of the task. (The consultant), 
as usual, was superbl His group leadership skills 
and ability to put everyone at their ease while 
getting a task accomplished Is excellent. He really 
/ listens to what folks are sayjngl 

, 76 



Table 22 

IHPACTS OF TAOS TECHNICAL ASSISTANCE 
ON SIGS 

1980-81 



Inpact (frequeficy) 
H • 9 [69t] 



Examples 



On the SIG and its Staff . , I 

'> Program tl^rrjf feat Ion and Operation (6) 

^ Support to the SIG Program and Staff (5l 
Enhanced Planning Efforts (4) 

Provided the SIG with a Source of Asslstan^ i}) 
Provided Useful Haterlals (2) 
Off the State Education Agency 
< Enhanced Planning Efforts' (3) ' 

Fac.1 II tated Cooperation (3) 

f Enhanced! Interagency Efforts^ (2) f ^ 

• " / 

On Other Individual's, Agencies or' Groups 

Enhanced SIG Effectiveness (^) 

t 

Provided Useful Haterlals (3) 
Enhanced In* Service Training (2) 



Clarified federal guidelines, clarified tasks to complete, helped Jn the delineation of 
staff roFes and responsibilities 

Enhanced morale, Increased staff confidence ^ 

Mejped In the development of a plan, helped delineate planning strategies, helped 
develop planning skills . . 

Provided an accessible source of assistance, prbvlded responsive assistance 

Provided useful and helpful publications 

Provided Information and assistance In planning, helped In the development of an 'early 
chl Idhood plan ^ 

Aided in the development of Interdepartmental linkages, resulted In a more positive 
relationship between the SEA and Institutions of higher education 

Provided In-service training In Interagency communlciit Ion, resullfed In the development 
of Inieraqency cooperation ' f ( 

Increased proiect participation at the local level, resulted In broader dissemination 
of project activities tand materials ' 

TAOS* publications were useful to LEAs, publications were used In local Information 
dissemination ^ 

Provided a positive ln*servlte experience for many, made possible^ Jn^iservlce training 
for regional Interagency teams 
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.the vi.sit proved to be very timely. .Th6 consultants' 
expertise and technical advice came at'a crucial 
moment In Ihe dynamicjs of the groups'^ organization 
structuring and search for information. 

• I feel that the workshop was very well planned,^ 
organized and managed. I complimertt the TADS staff 
involved, and look forward to seeing the completed 
product. \ 

.(the consultant) (displayed the same high degree of 
professionalism in her associations with our ^staff « 
and with the materials that she prepared for us. I 
enthusiastically recommend her as a fine graphic 
arts consultant. , 

Among the suggestion^ for chani^e which were received are: 

.1 think that it might have been more productive to 
<L schedule more actual working time-- to leave ^ the 
( workshop with the information/document completisd' 

(or at least the participants' portion$}. 

. (the consul tant) was not| very directive, ^e waited 
' / foAus to take the; initiative in the fonsuftati^pn 

whi^h sometimes slowed u$ down. | \ - * . ^ 

The SIG small group technical assistance meeting generated the fpMowIng, 

typical posit I've response: j 

■ • ■■ ' • 

.sharing' concerns/strategies with other SIGs; levjel 
of expertise shared by consultants were useful. 
Excellent meet ing— most useful, relevant and ^ 
enerbizing! ! ^ 

' No negativie comments 'were -received for smalt grou0 mei^tings. 

Information services received ofi I y positive comments, of which the 

following are typical: 



.it is an excellent service. In tb,e^spujh(f§|^t^ 1 1 is 

sources and this service was extremely helpful. 

.this Information, ts most ap^preciated. It would have 
taken our staff much time to put this together. 

.as usual, pronpt service and thoroughness the 
search rei^ofced the TADS reputation of meeting TA 
needs excel |ently. ^ 




The visitations also were well received* as exemplified by the follow- 
ing comment: , ^ 

.we appreciated the openness and willingness of^ * 
staff to share Information which was relevant 
and useful due to the many similarities in 
* ^ service delivery ne^eds between our two states. 

Conference/workshop presentations received primarily positive comments' 

such as: ^ * ^ , 

.method of presentation was varied; invo 
participants. Many different curricula we 
introduced. ^ 

•f* \ 

•I feel tnat the communication to the 2 audiences v 
was very good. It provided .an opportunity to 
exchange thoughts, ideas, and information. 

On the other hand, clients were willing to let us know whe^n they wer^ 

dissatisfied: 

\ 

• I feel that t^e actual presentation could 
have been ofJUCTk stronger. ^ * , 

Comments from the. sIp end-of-year suf^veys cover the broad rahge of 

technical assistance prbv'ided, and describe Its effects. The following 

comments are typical: 

.^s usual, TAOS provided our SIG with an eiccellent 
resource for Information, materials and consultants 
to assist In completion of gr^nt objectives. (The 
TA Coordinator) Is great and we enjoyed working 
wfth her this year. We look forward to another 
year of technical asslstaince and working with the 
cooperative, resourceful staff at TADS. * 

]^ ■ 

i. .exceptional flexTblllty on paft of TADS liaison; 

productive smill group plannl^ig session; exceHent 
link to other state ed. agencies; excellent and 
. prompt responses to requests for Information. ^ 

s Thank you for helping to make this year productive^ 

afid excUlngi 

•as usual, the assistance was excellent, timely, and 
extremely useful. The Information search provided a 
broad knowledge base of approaches and definitions 
for the sub-committee to use In refining their task. 



The on^sltiB consultation provided an exceTlent forum 
for issue*resolution, sclysdullng the remainder of 
the work and assigning work responsibilities and 
beginning' work on the actual task--deve loping guide* 
l(nes forHocal operation of our coordination pro* 
igrams. i |only wish we could have carried through 
on the other planned TA activities, which had to 
be cancelled through no fault of TADS. 

.the Early Childhood Unit of the Stat? Department 
of Education has benefited immehse^ly from its 
relatlonstiip with. TADS, From the .'Very outset of ; 
HCEEP activities when the TA coord I na tar came for > 
a planning sessiop, TADS* services have been de- 
livered in a most punq^tual , efficient, and cooper- ^ 
atlve manner, * A highlight of our staff's associa- 
tion with TADS occurred during February 9""t 1981, 
when two of us were afforded the opportunity to 
attend d TADS-sponsored workshop In Chapel Hill 
and to meet members 6f the TADS' staff. Their 
helpful, cordial atti tudes«made our visit most 
productive and pleasant. Your efforts have 
glven^^val idlty and credlbl 1 1 ty to the concept 
of technical assistance, ^ 
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SECTIONS: OTHER TECHNICAL ' ' 
ASSISTANCE SERVICES 

■This section of the report describes services which were provided to 
newly-funded demonstration projects and SIGs during I9BO-8I and also de- 

' ''V ? ces to Out reacj) ;£ roj ec ts , Research. I ns tttutes ^ Consort la , 

HCEEP projects In the' We^t and other early chl Vdhobd^special-^^^ 
professionals. Brief summaries of client reactions to the I98I-82 project 
and SIG orientation workshoj>s-«and.-#ie-^1^ 

are the results of two surveys of reactions to TADS* publications; 

- ^ Technical Assistance Service s 

^1.98.1-82 Demonstration Project Orientat Ion Conference 

An Orientation Workshop for newlyrfunded demonstration projects con- 
ducted by SEP, TADS and WESTARw^s held August 17-20, 1981 In Washlngtonv 
p.C* It was attended by fourteen representatives of eleven eastern projects. 
I^SJ - 82^S I g" driven tat i on ' Conference 

/ Newly-^f^^^^ SIGs were provided with an orientat ibn to HCEEP at a work- 
shop conducfed by SEP, WESTAR and TAOS on September lA-16, I98I, in Washington, 
D.C. Thirteen persons attended representing eight eastern SJGs. Needs asiesis- 
ments with two pf the SIGs were conducted immediately prior to and during the' 
workshop. TWo additional needs assessments were conducted later in September. 
Health Care/Education Relationship Workshop * . . . 

As described In Section 2, a.tofilcar workshop on the Health Care/Educ^t 1 on 
Rtflationshib In working with special needs Infants and their families was con- 
ducted In March, I98I. Of t/>e approximately 120 projects, 9 rwresented Outreach 

' ■ / ••'■■^ J ^2 / . : ^ 



projects from the East) and 1 was from a SIG.^ In addTtton^ tOL.these-^d — 
the 15 eastern demonstration project representati ves» 77 other professionals 
representing western demonstration projects, former HCEEP projects and other 
programs and agencies were In attendance. * 
TA Technology Planning ^ 

;^ A preliminary TA technolpgy planning meeting was initiated by TADS, 
^involving three^SEA special education dlrectorsT other fTA^providerSt and 
members of the TAD^' staff. The one-day workshop was held in September * 
1981 and resulted in a list of potential future acti vi.t ies ' leadl\j^ to the 
disseffH nation of thje TA technology developed by TADS. , 
SEA" Planning Meet 1 Kg s . , 

Two small' group meetings for ;SEA personnel involved in ear ly chi Idhpod/ 
special education were held in Chapel Hill in July and. August. The meetings 
were designed to allow an exchange of ideas and plans for increasing services 
to young chi Idren , and involved four representatives of different state edu- 
cation agencies at each meeting. , ' • 
Consortia 

TADS, along with WESTAR and SEP, tias been involVied In the continued sup- 
port of four HCEEP consortia: INTER-ACT, the Minority Leadership Consortium 
(MLC), the Urban Consortium, and The Rural Network. A TADS' staff person has 

served as an ex-officio member of the planning commit'tee (or advisory board) 

■ . . ■ ■ *i 

that has provided leadership for each^group*. Each planning committee met two 
or more times in planning the activities of their respect tve- groups. A desi'g- 
nated TADS', staff member participated in those planning meetings, and also 
served as a consultant and technical advisor to the chairperson and/or coor- 
dinator of each committee throughout thjB year via the telephone and mails. 
TADS'* staff attended twelve such planning meetings and provided between 8. and 
12 telephone consultations to the groups each month. In addition, TADS' staff 



participated In three consortium sponsoi^ed works hops^and helped review and/ 
or develop six to eight cdnsorti urn publications. To faci Mtate commuriica- 
t ion about and among the consortia, TADS added a regular feature to its 
newsletter, Emphasis , which described recent and upcomt rig consortium activ* 
rties.'V ■ , ■ • ' 

Publ i cations 

The three issues of EmphasI s and seven publications sent '•to rj^^s^^em^^^ 
demonstration projects and SIGs were also sent to the eastern rOu^rf^Cj^^XOj* 
ects (20) and research institutes (2) as well as the western demonstration 
projects (^7), outreach projects (27) , SIGs (10) and research institutes (2). 
A total of 1362 TADS' print products were sent to these HCEEP cl ients. 

A number of publ icat ions were also sent to 29 new eastern and western 

demonstration projects: * ■ . 

■ The HCEEP Overview and Qi rectory (1 980- 81 edition) 

, Infant Educat i on 

■ Identifying Handicapped Children 

■ Planning for Evaluation;- Documentation 

. Teaching Parents to Teach 

. Social and Emotional Development: The Preschooler 

. Early Education in Spanish Speaking Communities 

. Perspectives on Measurement x 

■ Serving Ydi4ng Handicapped Children in Rural America 

■ Resources for Early Education Programs for Children with Handicaps 

In addition, copies of the three I98O-8I editions of Emphasis were provided. 

In addition to Its eastern HCEEP clients, TADS provided copies of Its 
print products to other early childhood special^ educat ion professionals. 
Three-hundred thirty-two (332) publications and lO'*? copies of the three 
Issues of Emphasis were sent to groups such as western HCEEP projects, SEP, 
state directors of special education, ^early ct^l Idhood special education coor- 
dinators in SEAs, and TADS' consultants, 
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CI ient Reactions to Other Services 

ISBt-- 82 Demonstration Project Orientation Workshop ^ 

' The Orientation Wprks+iqp for ' new demonstration projects was evaluated 

by WESTAR In a report whidji has been submitted by them to SEP. The ,evaluai- 

■ . ■ ,*./.. 

tion was conducted- using a seven-point scale,, wfth seven being the most 
favorable r'ati'ng. ^ 

Ratings received from participants in the TAOS' service area indicated 
that the eight workshop goals were accomplished. 

The eleven workshop sessions for all participants were viewed on a use- 
fulness scale as being generally "very useful. 'V The highest ratings were 
received for the time managememt session (IT « 6.8) and .the^ntrod^ to TA 

session (X « 6.6). ' ^ 

The eastern participants were pleased with the arrangements of tjiie work- 
shop, providing ratings of 6.6 or highe^r for all- items related to thee cphf er- 
ence structure and accommodations. 1' ' 



1981-82 SIG Orientation/Planning Workshop 



. ^ Aspects of the meeting were rated on a five-point scale with "5" being 
the most favorable rating.* All average ratings of the meeting were in the 
average ("3*') to good ("4'*) range. Participants rated most highly, the 
organization of the meeting (x" « 4.2), the consultants who conducted the 
meeting (X ■ 4.5), dnd the ideas and activities presented (X » 4.2). Less 
highly rated was the extent to which the meeting met its object ives. Thi s 
was perhaps due to the problem solving nature of the meet ing~ something which 
the participants did not seem to be expecting. 
Health Care /Education Workshop ^ 

The topical workshop on Health Care/Education Relationships was also 
evaluated by WESTAR. Responses from 60 of the part l^ci pants on a seven- 



point sca^le Indicated that participants were satisfied with the workshop 

5.63)f that the objectives of the workshop were achieved (all means ' 
above 5-5) and that 15 of the 19 session^ were of highjquality and useful *' 
(means of 5-pO or higher). The poS|I i iye^ aspects of the workshop Weij-e listed 
as the information provided and "^opportunity to share ideas with pther profes- 
sionals. Recommendations were made to increase the time allotted for topical 
sessions. ^ ^ 

SEA Planning Meetings , 

Responses from 7 of the 8 participants In the two SEA Planning Meetings 
Indicated that the meetings were quite successful . On a six-point scale, 
respondents Indicated that the quality of the meetings, i.e., presentations, 
consultants, opportunities for sharing, organization, etc. was excellent 
(3f « 5.10). Satisfaction with tjrte-meetings, front the participants' view, 
w^s somewhat higher (IT = 5.18). Those who attended were very complimentary. 
They particularly liked the opportunity to share their concerns and successes 
and the organization and helpful, colleglal nature of the meetings. The only 
suggest Ion 'for Improvement was that more time be allotted td the meetings. 
Publ icatlons 

During I98O-8I TADS conducted two surveys to gather ttlent opinions of 
Its print products. February a survey was conducted to gather information 
regarding six of the >Qpks and monpgraphi^ thaj^ had been sent to clients the 
prevl'ous fall. A proportional, stratified random sample of 102 eastern and 
western demonstration projects, SIGs and outreach proXftptSUwas select^ to 
receive the survey. Surveys were received from 7^ HCEEP clients representing 
^0 demonstration projects, 15 SIGs and 19 outreach projects. The response 
rate, thet-efore, was 72%. 

In th|B^ survey respondents were first asked to Indicate if they had 

8b ' ■ 



ihecetved the publication. If their response was "yes,** they were then asked 
if they had reviewed the pub I ! cat ion. If they had reviewed the publ i ca; ion 
they were then asked to rate its quality and usefulness. Table 23 presents 
the survfey results^ 

As in previous years, quite a few respondents indicated that they had not 
reteived TAOS* publications. Again, we are not surg if this is due to problems 
with the postal service, the addresses < we have for projects, changjng personnel 
or failure of project staff ,to recognijsre that received publications are from 
TADS. ■ ' - ' • " . . ■ . ^ 

, , With the exception of Planning Services for Young Hand I capped" Indian and 
AJaska Native Children , a book that addresses the needs of some but' not all 
projects, over 60% of respondents who received publications reviewed them. 

The quality of al 1 publ ications was rated as good (a rating of **4*') or 
better. The most highly rated book was Finding and Educating the High^'Risk 
and Handicapped Infant * Publications for specific chi Idren or ci rcumstances 
v/ere rated as being of good quality but less useful to the total group than 
those which addressed more general concerns and issues. 

TAOS attempted a telephone survey during August I98I to obtain reactions 
to Emphas is and the 1980*8l Qverview. and Di rectory .' A 25% random sample of 

eastern and western demonstration projects, SIGs and outreach projects, was 

/ - ■ 

drawn-. Oue to project and SIG funding schedules, project staff vacations 
and project personnel changeover, only fifteen surveys were completed, after 
numerous attempts. This Is not a sufficient number to use the numerical data 
with confidence. However, the comments which were received do provide useful 
Information. 

Regarding Emphasis , reactions were posi t ive, and several useful suggestions 
were received. Sample comments were: 



Table 2^ 

HCEEP CLIENT OPINIONS ' ' 
OF TADS PUBLICATIONS 

1980-81' 



. , — - — , . — , _ 






Received 


Reviewed « Quality Usefulness 

N 5? . X^' P 


1. 


Finding and Educating the 
Hiqh*R!sk and Handicapped 
Infant, Ramey, Trohanis, 
Eds.; Meyer, Managing Ed. 


52 70% 


kZ 92%^ 


i».92 


k.kS 


2. 


The Young Blatk Exceptional 
Child: Providing Programs 
and Services* Jiaclcson, Ed. 


Sf 69% 


3k 67% 


A. 56 


3.91 


3. 


Planning Services for Young 
.Hand i capp ed ' Amer 1 can Indian 
and Alaska Native Children. 
Johnson, Ramirez* Trohanis, 
Walker; Eds. 


55 74% 


25 45% 


'».68 


3.17 


A. 


Serving Young Handicapped 
Children in Rural America. 
Black, Gilderman, Jackson, 
Woodard, Eds. 


50 68% 


39 78% 


k.77 


3.90 


5. 


Program Strategies for 
Cultural Diversity. 
Jackson, Karp, Eds. 
TAOS and WESTAR 


3k 46% 

\ 


21 62% 


k.(>7 


'».50 


6. 


A Practical Guide to 
InstI tutional izlng 
Educational Innovations. 
Lambour, Rostetter, Sapir, 
Taha, Eds. ^ - 


37, 50% 


25 68% 


k.7e 


i..31 


a - 


> A mean of respondent rating^ 
being most favorable 


on a six-point scale with a 


rating of 




b - 


• This ie the percentage of those who both received and reviewed the 
publication 
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.It fs helpful—suggest you use more project news 
whlch'doesn* t get out of ^date. "Dates'* column 
Is useless by the time I receive k. , 

■ 

.1 would I Ike to see It published more often. 

.1 always share It With others. Would like you 
to include proposal deadlines. 

.Pliease continue the consortia column. 

'< " 

.It Is useful"! squeeze out time to read It. 

.Format and size are pood--wouldn ' t want to see ' 
It larger or longer. 

Regarding the Overview and Directory ^ comments were Universally positive 

All project personnel reported that It was usef^ul, and that It was of high 

qu^lllty and helpful In locating resources. 




SECTION 5i. SUMMARY AND DISCUSSION 

A large quantity of data has been presented tn the previous sections 
of this report* It la the. purpose of this section to: (a) summarize the 
data presented; (b) provide a discussion of their meaning from our perspec- 
tive; and it) offer a series of recommendations^ for the upcoming year of 
TAOS* operation. ' ^—^.-..^ - 

The evaluation plan for TADS contains the questions to which this 

^valuation was foctised and the criteria for judging the adequacy of the 

resuJts. In order to provide a conclusion to this report, the , f landings 

will be discussed ,in relation to these questions and criteria. 

Has TADS fulfilled the provisions of its contract with Special Education 
Programs? If not, why not? 

As indicated in Figure 2 (pg« 8), most short*term objectives which 
comprise the TAOS' contract with SEP were met during the contract year. One 
objective regarding the evaluation of TADS is met with the completion of this 
report. The remaining unmet objective concerns the development of publications. 
One remaining monograph (Infant Curricula) has been written but has, not yet 
been edited and printed. When It Is completed, this objective will also have 
been met. 

In reference to the evaluation question, TADS did not complete all of 
the objectives of Its workscope by September 30,' 1981. It dld^ however, meet 
of them an^,'^ more Importantly, met alt of the objectives whlc|) dealt with 
the provision of services to Its clients. Those which were not completed were 

' s Bo 
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due to rfeasons of necessity, I.e., an evaluation repprt cannot be written 

until all services have been provided and documented, and ^the scope and time 

consuming nature of the task, I.e., the development of many publ Icat ions 

written by a variety of authors durPng one year. 

How effective has TADS been In providing services to its clients? 

The following statements provide an overview of the services that were 

provided by TADS to clients in I98O-8I. 

-TADS provided a total of 11^8 services to its 66 I98O-8I primary 
clients (eastern demonstration projects and SIGs) for an average 
, of 17.39 services to each client. 

•Far xJemonstra^tion projects r the greatest number, of direct services 
were provided in the areas of All Areas (51)', Services for Children 
(^3)» Demonstration/Dissemination (^3) and Evaluation (3^). For 
SIGs, the greatest, number of direct services were in the areas of 
Program Development and Management (32) and Personnel Training (2^). 

-The most used, form of direct service del ivery was the on-site 
consultation (8I in specific content areas; 97 with the inclusion 
of on-site needs assessments) 1 This was followed closely by the 
additional TA provided by the TADS' staff (65). 

-Without worlcshop/conference presentations, In which participation 
was unusually large, 11J3 cl lent related personnel were involved 
In the TA for. an average of 17-17 persons per individual project 
or SIG for the year. Including the presentations, 1^08 persons . 
participated in the TA. 

-Without including the wprkshop/c6nf erence presentations, an average 
of approximately 3 persons from the projects or SIGs participated 
in each! direct servi ce' provided by TADS. ^ 

-Most demonstration (Project staff were Involved,, on the average, in 
services provided in the content areas of ^taff Development (8.17) 
and All Areas (6.12). Most SIG staff, on the laverage, were, involved 
In servites provided in the areas' of Program Development and Manage- 
ment (^.22), Communication and Dissemination (3.9^) and Personnel 
Training (3.93) (again excluding presentations) . 



••All Areas" Includes the hU heeds assessments that were conducted for 
demonstration projects. 

\ 
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-Host demonstration project staff, on the average, were 
tnvo1vi*d in TA when the form of service delivery was the 
needs Assessment (6.84) or on-site consultation (5% 24). 
Most SIG related persons, on the average, were involved 
In conference presentations (27-50) followed by on-site 
consultations (7^35) • 

•A total of 513.95 days of TA were provided to clients 
for an average of 7-79 days of TA per demonstration ^ 
project or SIG, Of these, 35^.91 days of TA were pro- 
vided to demonstration projects (X ■ 6. 70) and 159. OA 
days were provided to SIGs (]f « 12.23). 

-The lengthiest TA services, on the average, were con- 
. j^^l^^^l^^^ and other specialized services. Host time, 
on the javerage, was spent In the content area of Demon- 
stration/Dissemination (2. OA) for demonstration projects 
and Evaluation (A.A2) for SIGs. 

iHost of the tA servicbs were delivered by TAOS* staff 
members and TAOS' consultants. The otherswere delivered 
by TADS* staff and/or others such as WESTAR, SEP and NASDSE. 

-TADS provided 56O services to other eastern HCEEP projects, 
i.e., 1981-82 first year demonstration projects and SIGs, ' 
outreach projects, the early childhood institutes and the 
HCEEP consortia. One-hundred and s<!^venty of these were 
direct services white 390 were publications. 

-TAOS provided 1245 services to others. These included 
western HCEEP projects and other early childhood special 
education professionals. The 92 direct services were In 
the form of workshops and resource idehtif icatibn. The 
remaining 1153 were TAOS' print products. 

-tads' provided a total of 1708 services to all eastern 
HCEEF programs. Four-^hundred/^and ninety-nine (A99) were • *' 

- cllreCt^ services tfnd 1209 we r^ publ i cations ^ , 

^ ^ * • ■ * ' 4 • i /I ^ 

" ■' 

The criteria for judging the effectiveness of this effort was that services 

( ... 

specified In the contract and individual Hemoranda of Agreement be delivered. 
All services In the Hemoranda of, Agreement with the exceptloh of thoqfi few can- 
celled by the client and/or TAOS due to schedul Ing problems were delivered. 
Other contracted for services. I.e., workshops and distribution of publications, 
were also delivered. In addition, TADS provided many services for information 
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or documents In response to requests from clients and the field. We conclude. 



therefore, that TAOS has been quite effective In delivering services to Its 

« I* 

clients. 

How sattsfactory have been the services provided to clients by TADS? 

A review of the findings indicates the following to be evidence to answer 
this question: 

-On the whole, client reactions to the technical assistance 
provided by TADS were well above average and surpassed ••excel lent*' 
for a majority of the services provided. 

-Needs assessments were highly rated by both cl lent groups. On-site 
assessments for demonstration projects were more highly rated than 
j self-admtnlstered assessments. 

•For demonstration projects, the highest ratings of quality and 
say^factlon were given in the content areas of Staff Development, 
Demons^ratlon/DIssemlnat Ion and Administration. For SIGs, highest 
ratings were given, to servUes In the areas of Communication/ 
01 ssemi nation. Personnel Training and Program Development and 
Management . 

-Above average, but somewhat lower, ratings were gjven by projects 
• In^the area of- Services for Parents. The same was true fbr 
I evalualllbn services delivered to SIGs. 

-On^sft« consDltatlonr ^d y'sltatlons were the highest rated 
Services by projects and^SIGs. 

r: ^ - i ' . . 

-Ratings of quality and satisfaction for reviews and critiques 
were well above average but somewhat lower than other services. 

I- . . , ^ .i 

-Overall ratings for workshops were ••good** or better. . 



-TADS'' pubHcations were rated, on the average, as being good 
and useful. Highest ratings were given to those topics which 
addresse.d needs of the majority of the clients. Somewhat Tb^er, 
but above average, ratings were given to those topics which 
addressed the , needs of subgroups of the cllients. 

-Numerical data and client comments Indicate that clients, on 
the whole, are satisfied with their technical assistance and V 
with the TAOS organisation. 

Criteria for this question required that clients, on the average, perceive 
TADS* technical assistance to be ••good'* or higher for each type of ,TA. 
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Findings indicate that all services were rated, on the average, as '*good'* 
and that most services were perceived to be "excellent'' or better. Clear^ly, 
'these criteria were met and surpassed. 

. What has been the impact of TADS' technical assistance on its clients? 

■. ■ • ^ ■ ' 

' Several types of information were gathere^d to determine the impact of 

TADS' technljCdl assistance on clients. Suiranarized, they reveal the following: 
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-Significant progress toward completion of work in Identified 
need areas was made , by both demonstration projects and SIGs.. 

-On the average,/^lml lar progress was made by SIGs (l.&D) and 
demonstration pi^ojects (1.53)- Differences in, means of status 
before and after TA were statistically significant (p • .0001) 
for both groups. ' 

-Thirty-one percent (31%) of the demonstration projects and SIGs 
received assistance from other persons or organizations In ad- 
dition to TADS In addressing their needs. 

-There were not significant differences In the amount of progress 
made with regard to needs for those clients who did nor did not 
received additional assistance. ) 

•For 8A% of the needs of demonstration projects an^Sljls, TADS 
wias reported as having made a substantial contribution to* thel r 
progress. i 

-With the exception of two clients' ratings on a total of 6 of 
the 53 Items, all organizational and progra^rtnattc Impacts re- 
ported by demonstration projects were positive. 

-^For . demonstration projects, the greatest percentages of Impacts 
reported were organizational. 

-For both demonstration projects and SIGs, the organ Izattbnal 
area of greatest Impact was In program clarification. 

-Other organization^^} *reas In which there was a high level of 
Intact for demonstration projects were effects on staff a,dmln- 
Istratl.on and program operation. For SIGs, relations with 
other programs or agencies and the effects on staff ware high 
Impact areas. ^ . 

-Highest programmatic Impacts for demonstration projects were In 
the* areas of evaluation, demonstration/dissemination and Impacts 
on staff. For SIGs, there were' Impacts In perspnnel training 
and Interagency relational Inking. 



-Areas of least Impact for demonstration projects were 
those which Included persons, agencies or e\;ents 
external to their program. Impacts were also Jess 
In the programmatic area of Services for Parents ^d 

"Staff Development. 

In regard to the extent to whlch^tasks relative to Identified technical 
assistance needs were accomplished, the criteria required th^t there be a 
signif^l^ant (pS.05) difference between the initial status of identified 
technical assistance needs and thr status at the end lof the year. For both • 
demonstration projects and SIGs this was the case. The criterion, therefory 
was met for both client groups.< 

For Impacts of technijjal asststance, the plan stated that 95^ of the 
impacts would be Judged by, the clients to be positive. The findings revealed 
that 97% of the Impacts for dorionstratlon projects and 100% of the Impacts 
for SIGs were perceived to be positive. Furthermore, all clients indicated 
that there were Impacts of TA on their programs and there were impacts in 
each area assessed by the Instruments^ ' 

Vte conclude, therefore, that there were many positive impactjs of TADS', 
technical assistance on its clients and their programs for ybungTfiarid I capped 
children aqd thei r fami 1 ies. ^ ' 

Recommendations 

On^ the basls^of the rpsults 'of this evaluatloa, we offer the following 

' 0 . . 

recomnendations for consideration by SEP and TADS. 

1. TADS SHOULD CONTINUE TO REFINE ITS PROCE|il(RES AND PROVIDE TA IN THE 
GENERAL, FRAMEWORK AND MANNER. IN WHICH IT W^S PROVIDED IN I98O-8I. 

2. TADS SHOULD EXAMINE SERVICES IN THOSt FEW AREAS WHICH WERE NOT AS 
HIGHLY RATED AS OTHERS AND TAKE STEPS TO IMPROVE THEM. THESE AREAS ARE: 

At SELF-ADMINISTERED NE^DS ASSESSMENTS, TA IN THE CONTENT AREAS 
OF SERVICES FOR PARENTS AND EVALUATION AND INFORMATION SERV- 
ICES AND REVIEWS AND CRITIQUES FOft DEMONSTRATION PROJECTS. 

B. TA IN THE CONTENT AREAS OF EVALUATION AND REVIEWS AND CRITIQUES 
FOR SIGS. 
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THE TADS' EVALUATION PLAN, SHOULD. BE REFINED TO ACCOMPLISH THE 
FOLLOWING: 

A. SPECIAL STUDIES OR EXPANDED DATA COLLECT TON IN AREAS 
REQUIRING EXPLANATION (N THIS REPORT. 



/ . 
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APPENDIX A 
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MEANS OF ORGANIZATIONAL AND PROGRAMMATIC 
IMPACTS OF TECHNICAL ASSISTANCE 
DEMONSTRATION PROJECTS - 



1980-81 



IMPACTS 


YEAR 


OF FUNDING 


TOTAL 


Orgatili^at lonal 

■ - . . " '■■^ 


V* 


2 


' 3 




I. Administration 


1.933 


2.07 


1.94 


1.98 


2. Staff 


2.20 


1.84 


1.91 


1.98 


3* Program Clarification 


2.06 


2.12 


2; 13 


2.11 


4. Program Operation 


1.95 


1.98 


2.14 


2.03 


5* Program Support 


'•53 


1.50 


1.83 


1.64 


6, Benefits to Non-staff Persons 


1.53 


1.60 


1.96 


1. 71 


7. Relations with Others 
• 


1.64 


1.60 


2.03 


1.82 


Programmatic 










!• Children 


1.97 


2.04 


2.03 


2^1 


2. Parents 


1.50 


1.75 


1. 71 


1.64 


3. Staff 


1.76 


1.89 


2.14° 


1.95 


4. Oemonstrat Ion/0 Is semi nation 


2.09 


1.76 


2.07 


1.96 


5. Admini St r« ion/Management 


1.83 


1 .86 ^ 


1.74 


1.80 


e 6. Evaluation 


2.21 


1.71 


2.04 


1.96 


ir ' 











a - These means were derived from data for those projects reporting any 
Impact on an Item. Projects reporting "no impact** were excluded from 
the analysts for each Item and for the totals. 
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